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ILLUSTRATIONS 


Figure  1  Stimuli  used  in  experiments  on  the  effects  of  parallels  on  localization  3 

accuracy. 

Figure  2  Change  in  localization  threshold  produced  by  addition  of  parallels  3 

between  targets  (in  only)  or  outside  targets  (out  only).  Five  observers. 

Figure  3  Localization  threshold  for  a  pair  of  square  targets  separated  by  4  degrees,  4 

as  a  function  of  the  length  of  the  side  of  the  square.  Inner  edge  distances 
were  the  same  for  each  target  size.  Two  observers. 

Figure  4  Bias  is  the  absolute  value  of  the  difference  between  the  psychometric  5 

functions  obtained  with  a  large  vs.  small  comparison  and  with  a  large  vs. 


large  comparison.  The  large  vs.  small  comparison  was  done  in  both  orders, 
small  first  then  large  and  vice  versa,  and  the  data  averaged.  Average 
separation,  4  degrees. 

Figure  5  Localization  thresholds  measured  as  a  function  of  retinal  eccentricity. 
Average  separation  was  4  degrees.  Observers  RLW  and  RJP. 
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L  STATUS  OF  RESEARCH 


A.  Introduction 

During  the  past  year,  large-scale  localization  has  become  recognized  as  a  major  research  topic 
in  vision.  Researchers  who  previously  had  focused  on  localization  of  objects  that  are  separated  by 
only  a  few  minutes  of  arc  —  where  the  remarkable  hyperacuity  thresholds  are  obtained  -have 
recognized  that  the  general  ability  to  localize  more  widely  separated  objects  with  equally  high 
relative  precision  is  just  as  remarkable  and  important.  The  research  described  here  has  been  at  the 
forefront  of  this  development. 

Our  research  has  focused  on  two  general  themes: 

•  Stimulus  context  plays  a  larger  role  in  localization  (i.e,  separation)  judgments  than  it 
does  in  contrast  detection. 

•  Localization  thresholds  can  be  determined  at  several  sites  of  processing,  and  therefore  a 
deliberate  effort  must  be  made  to  elicit  the  properties  of  the  localization  mechanism  per 
se. 

A  description  of  the  research  that  we  have  done  and  are  doing  on  these  two  themes  constitutes  the 
body  of  this  report.  Where  possible,  reference  is  made  to  completed  manuscripts,  which  are 
included  as  appendices. 


B.  Effects  of  Context  on  Localization  Judgments 

Unlike  contrast  detection,  localization  judgments  appear  to  be  intrinsically  tied  to  the  context 
in  which  they  are  made.  Most  strikingly,  we  have  shown  that  depth  judgments  are  intrinsic  in 
spatial  frequency  discrimination  judgments.  Observers  cannot  ignore  the  depth  to  make  judgments 
solely  on  the  basis  of  the  difference  in  the  retinal  spatial  frequencies  of  gratings  (Appendix  A). 

We  have  also  found  that  the  addition  of  flanking  stimuli  affects  large-scale  localization  in  a 
way  that  suggests  a  further  context  effect.  If  a  pair  of  parallel  bars  is  added  to  a  pair  of  target  bars 
as  shown  in  Figure  1,  and  the  positions  of  the  parallels  are  randomly  jittered  from  trial  to  trial,  then 
localization  accuracy  for  the  targets  decreases.  Part  of  this  effect  is  probably  due  to  increased 
noise,  but  the  effect  is  larger  when  the  two  parallels  lie  outside  the  target  pair  than  when  they  lie 
between  the  targets.  The  outside  parallels  appear  to  create  a  framework  forjudging  the  separation 
between  the  targets.  When  that  framework  changes  size  randomly  from  trial  to  trial,  the  accuracy 
of  the  separation  judgment  is  impaired  [1].  The  threshold  elevations  produced  by  the  outside 
parallels  and  the  inside  parallels  are  shown  in  Figure  2. 


In  only 


out  only 


Figure  2.  Change  in  localization  threshold  produced  hv  addition  of  parallels  between  targets  <m 

only)  or  outside  targets  (out  only).  Five  observers. 

We  are  currently  examining  the  effect  of  target  si/c  on  separation  judgments.  We  ha\c  hum 
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e 


Average  distance  between  targets: 

Distance  between  parallel  and  nearest  target: 
Bar  height: 


Figure  1 .  Stimuli  used  in  experiments  on  the  effects  of  parallels  on  localization  accuracy 
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in  control  experiments  that,  over  a  large  range,  target  size  has  no  effect  on  localization  accuracy, 
when  the  target  pair  is  centered  on  the  fovea.  Data  for  two  observers  and  four  target  sizes  are 
shown  in  Figure  3. 

5 
4 

As/s  3 
(%) 

2 
1 
0 
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Figure  3 .  Localization  threshold  for  a  pair  of  square  targets  separated  by  4  degrees,  as  a  function 

of  the  length  of  the  side  of  the  square.  Inner  edge  distances  were  the  same  for  each 
target  size.  Two  observers. 

Preliminary  data  suggest,  however,  that  target  size  does  affect  the  perceived  separation.  If 
comparison  is  made  across  target  sizes,  e.g.,  if  the  separation  between  two  large  targets  is 
compared  to  that  between  two  small  targets,  a  bias  is  evident  as  shown  in  Figure  4.  In  this 
experiment,  the  targets  were  square  and  differed  in  size  by  a  factor  of  four.  The  large  targets  were 
66  arcmin  on  a  side  and  the  small  were  8  arcmin  on  a  side.  The  observer  was  asked  to  compare  the 
distance  between  the  inner  edges  of  the  targets.  The  data  indicate  that  for  this  observer,  at  least,  the 
inner  edges  of  the  small  targets  appear  to  be  farther  apart  than  those  of  the  large  targets.  If  the 
observer  were  comparing  the  centers  or  outer  edges  of  the  targets  instead  of  following  the 
instructions,  then  the  larger  objects  would  appear  to  be  farther  apart,  because  those  features  are 
farther  apart.  Instead  we  find  the  reverse:  the  small  targets  appear  to  be  farther  apart,  although  the 


inner  edge  separation  is  actually  the  same. 
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Figure  4.  Bias  is  the  absolute  value  of  the  difference  between  the  psychometric  functions  obtained 

with  a  large  vs.  small  comparison  and  with  a  large  vs.  large  comparison.  The  large  vs. 
small  comparison  was  done  in  both  orders,  small  first  then  large  and  vice  versa,  and  the 
data  averaged.  Average  separation,  4  degrees. 


A  plausible  explanation  for  this  effect  is  that  the  smaller  targets  appear  to  be  farther  away,  so  the 
observer,  who  is  trying  to  estimate  the  physical  properties  of  the  stimulus  [  1],  perceives  them  as 
being  farther  apart.  This  interpretation  allows  him  to  reconcile  the  fact  that  the  retinal  separations 
are  the  same  with  the  fact  that  the  (perceived)  viewing  distances  are  different. 


The  perceived  spatial  frequency  shift  (PSFS)  that  occurs  when  a  grating  is  surrounded  by 
another  grating  of  a  different  spatial  frequency  (but  the  same  orientation)  is  another  example  of  the 
importance  of  context  in  separation  judgments.  The  perceived  frequency  is  altered  by  the  adjacent 
context,  whereas  the  contrast  threshold  is  not  [2].  The  importance  of  context  in  size  judgments  ha 
long  been  recognized:  The  simultaneous  PSFS  is  simply  the  contemporary  version  of  the  Titchner 
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figure,  in  which  the  perceived  size  of  a  disk  is  altered  by  surrounding  it  by  smaller  or  larger  disks. 
However,  this  context  effect  does  not  appear  to  be  intrinsic  to  the  localization  mechanism  itself. 
The  PSFS  depends  on  the  retinal  spatial  frequencies  of  the  objects,  not  on  their  object  spatial 
frequencies.  On  the  other  hand,  the  effect  persists  even  if  the  test  gratings  being  compared  have 
different  retinal  spatial  frequencies,  provided  they  have  the  same  object  spatial  frequencies.  Thus, 
the  bias  is  introduced  at  a  stage  of  processing  in  which  retinal  spatial  frequencies  are  represented, 
but  the  comparison  is  made  at  a  stage  in  which  object  spatial  frequencies  are  estimated  (Appendix 
F). 

This  duality  has  appeared  in  the  results  of  other  localization  experiments  as  well.  It  is 
interesting  in  its  own  right  and  relates  to  the  second  general  issue  that  we  are  investigating:  the 
problem  of  isolating  the  localization  mechanism  and  understanding  its  relationship  to  more  distal 
stages  of  visual  processing. 

C.  Isolating  the  Localization  Process  From  More  from  Distal  Stages  of  Spatial  Processing 

Localization  thresholds  cannot,  in  general,  be  accounted  for  by  either  the  retinal  or  the  initial 
cortical  stages  of  processing  that  have  recently  been  so  extensively  studied  and  modeled.  Morgan 
and  Ward  [3]  have  provided  evidence  that  hyperacuity  thresholds  cannot  be  accounted  for  by 
popular  "spatial  frequency  channels"  models.  Using  a  different  approach  [4],  I  have  shown  that 
large-scale  localization  also  cannot  be  explained  by  such  models  (Appendices  B  and  D).  In  fact, 
large-scale  localization  thresholds  are  remarkably  insensitive  to  those  aspects  of  the  stimulus  that 
arc  fundamental  in  a  spatial  frequency  channels  representation. 


Localization  presumably  occurs  at  a  higher  (more  proximal)  level  of  visual  processing. 
However,  the  properties  of  this  higher  level  are  not  readily  revealed.  It  is  our  working  hypothesis 
that  under  some  circumstances,  localization  thresholds  are  determined  at  stages  of  processing  that 
precede  the  site  of  the  separation  judgment.  The  localization  threshold  is  determined  wherever  the 
visual  system  runs  up  against  its  limits  in  performing  the  task.  If  the  contrast  is  too  low,  or  the 
objects  too  small,  the  limits  may  occur  at  the  photoreceptor  level.  Hirsch  and  Hylton  [5,61  have 
found  conditions  in  which  the  limits  appear  to  occur  at  this  or  a  slightly  higher  level.  If  the 
exposure  duration  is  short  and  the  objects  are  small,  localization  thresholds  may  be  determined  by 
the  limits  of  the  initial  cortical  representation.  Yap,  Levi,  and  Klein  [7]  have  shown  conditions 
under  which  this  appears  to  be  true.  They  find  that  the  localization  threshold  is  completely 
determined  by  the  retinal  eccentricity  of  the  objects  when  cortical  magnification  is  taken  into 
account.  On  the  basis  of  such  results,  they  theorize  that  separation  judgments  are  made  by  a 
process  that  acts  like  a  yardstick  on  the  initial  cortical  representation.  This  yardstick  has  a  constant 
error  associated  with  it,  independent  of  the  distance  being  measured. 

Our  approach  is  to  try  to  use  stimuli  that  do  not  push  the  limits  of  the  earlier  stages  of 
processing,  in  order  to  determine  the  limits  of  the  localization  process  itself.  We  use  relatively  large 
targets,  of  high  contrast  and,  probably  most  important,  of  long  duration.  Such  stimuli  yield  lower 
localization  thresholds  than  are  obtained  with  other  combinations  of  parameters  (Appendix  C). 
When  such  stimuli  are  used,  localization  thresholds  vary  only  slightly  with  eccentricity.  The  targets 
in  the  experiments  discussed  here  were  1°  squares,  with  an  inner-edge  average  separation  of  4°. 

The  exposure  duration  was  500  ms.  Data  obtained  on  two  observers  are  shown  in  Figure  5.  The 
increase  in  localization  thresholds  with  eccentricity  predicted  by  cortical  magnification  [8|  would 
result  in  best  fitting  lines  that  crossed  the  x-axis  at  -0.77.  The  best  fitting  lines  to  our  data  cross  at 
-22.5  and  -26.7,  respectively;  that  is,  the  "fovea!”  threshold  doubles  at  about  25  degrees,  instead 
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of  0.77  degrees,  as  Levi  et  al.  [8]  found  with  small  stimuli.  In  short,  the  eccentricity  effect  is  much 
smaller  with  these  stimuli  than  with  those  used  by  Yap  et  al.  17].  To  the  extent  that  the  localization 
thresholds  we  found  are  less  dependent  on  eccentricity,  I  believe  that  they  come  closer  to  showing 
the  limits  of  the  localization  process  itself. 


-10  0  10  20  30  40 

Eccentricity  (degrees) 


Figure  5.  Localization  thresholds  measured  as  a  function  of  retinal  eccentricity.  Average 

separation  was  4°.  The  arrow  indicates  the  point  of  intersection  predicted  by  cortical  sampling. 
Observers  RLW  and RJP. 


Even  with  these  stimuli,  there  is  still  a  small  effect  of  eccentricity.  We  intend  to  repeat 
these  experiments  with  image  stabilization  and  no  fixation  point  so  that  the  observer  can  freely 
attend  to  the  peripheral  targets.  This  should  eliminate  any  variation  in  attention  with  eccentricity. 
We  may  also  try  cuing  the  observer  as  to  the  eccentricity  at  which  the  targets  will  be  presented,  to 
further  reduce  the  positional  uncertainty  associated  with  peripheral  presentation.  We  would  like  to 
he  able  to  eliminate  eccentricity  effects  entirely,  if  this  can  be  done  with  stimulus  manipulations  that 
are  theoretically  sound.  This  goal  assumes  that  the  localization  mechanism  acts  independently  of 
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the  retinal  eccentricity  of  the  objects.  Such  an  assumption  seems  plausible  because  of  the  other 
classes  of  independence  that  we  have  discovered.  Most  of  these  are  covered  in  the  Appendices. 

The  response  of  the  localization  mechanism  is  independent  of: 

•  Exposure  duration  (Appendix  C) 

•  The  spatial  characteristics  of  the  targets  (  Appendices  B  and  D) 

•  The  orientation  along  which  separation  is  judged  (Appendix  E) 

•  The  relative  orientations  of  the  test  and  reference  stimuli  [9] 

•  Retinal  image  size,  that  is,  response  depends  on  overall  object  properties,  but  not  on 
individual  properties  of  the  retinal  image  (Appendix  A). 

The  best  example  of  isolating  the  localization  mechanism  is  described  in  a  1986  paper  1 101 
on  exposure  duration  effects  (Appendix  C).  There  I  showed  that  the  well-known  effect  of 
exposure  duration  on  small-scale  localization  thresholds  is  not  intrinsic  to  the  localization  process  at 
all,  but  instead  is  another  example  of  the  long  integration  times  associated  with  the  processing  of 
high  spatial  frequencies.  This  effect  had  previously  been  attributed  to  the  localization  process  and 
inferences  about  the  nature  of  the  localization  process  had  been  drawn  from  that  attribution, 
whereas  the  effect  actually  occurs  at  an  earlier  stage  of  processing. 

D.  Experimental  Issues 

Revealing  the  properties  of  the  localization  process  is  not  easy.  Localization  thresholds  can 
be  determined  at  stages  of  processing  that  precede  the  localization  judgment,  as  we  have  seen 
above,  and  isolating  the  process  from  the  effects  of  those  prior  stages  is  not  trivially  done.  The 
effects  of  context,  which  seem  to  be  central  to  the  localization  mechanism,  are  particularly  difficult 
to  capture.  We  have  found  substantial  variation  across  subjects  in  some  of  our  experiments,  and 


have  seen  similar  variation  in  the  data  from  other  laboratories  doing  research  in  this  area.  Por 
example,  we  have  measured  the  effects  of  randomly  jittered  parallel  bars  on  localization  accuracy  in 
six  observers.  In  five  observers  the  outside  parallels  had  a  larger  effect  than  the  inside  parallels. 
The  sixth  observer  showed  no  effects  of  the  parallels  at  all.  Similarly,  despite  repeated  attempts 
with  several  observers,  we  have  been  unable  to  replicate  Regan  and  Beverley's  [11]  effects  of 
pattern  adaptation  on  frequency  discrimination  thresholds  (Appendix  F).  Our  laboratory  experience 
with  other  paradigms  exploring  the  effect  of  context  suggests  that  this  may  not  be  due  to  inadequate 
experimental  techniques  in  one  of  the  laboratories,  but  instead  may  be  due  to  some  subtle  difference 
in  context,  or  even  to  inter-subject  differences. 

Finally,  we  note  that  the  experimental  techniques  that  have  been  so  successful  in  revealing 
some  of  the  properties  of  the  initial  stages  of  cortical  processing,  e.g.  pattern  adaptation  or  masking 
apparently  cannot  be  used  to  probe  higher  levels  of  processing  (Appendix  F),  although  they  can 
shed  light  on  the  relationship  between  the  more  distal  stages  and  the  localization  process.  To 
uncover  the  properties  of  the  localization  mechanism,  new  techniques  must  be  developed.  The 
experiments  reported  above  are  first  steps  in  that  direction. 


n  COLLABORATIONS  AND  SCIENTIFIC  VISITS 


Dr.  Ben  Krose,  a  postdoctoral  fellow  at  California  Institute  of  Technology  under  Dr.  Bela 
Julesz  and  Dr.  David  van  Essen,  is  working  with  me  on  a  joint  project.  He  was  at  SRI  for  two 
weeks  and  we  have  continued  to  collaborate  since  then  by  phone,  letter,  and  computer  disks.  Dr. 
Krose  and  I  are  investigating  the  effects  of  spatial  interactions  on  rapid  pattern  discrimination.  We 
are  using  the  eyetracker  to  present  stimuli  at  a  fixed  location  in  the  periphery  without  having  to  use 
a  fixation  point  The  idea  is  to  present  the  target  at  a  fixed  retinal  locus  to  allow  the  observer  to 
focus  his  attention  and  then  measure  the  effect  of  adding  distractors  at  various  distances  from  the 
target  We  have  found  two  classes  of  effects  of  the  distractors:  one  class  is  quite  local  and  depends 
on  the  number  of  distractors,  and  one  class  is  more  global  and  is  independent  of  the  number  of 
distractors. 

Dr.  Don  Kelly  and  I  completed  and  published  some  research  on  the  early  stages  of  spatial 
vision  (Appendix  G).  This  research  was  an  extension  of  work  we  had  previously  done  together,  it 
does  not  bear  directly  on  the  localization  problem. 
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"Exposure-duration  effects  in  localization  judgments,"  J.  Opt.  Soc.  Am.  A  3, 
1983-1988,  1986. 

"Position  and  spatial  frequency  in  large-scale  localization  judgments,"  Vision  Res.  27,  3, 
417-427,  1987. 

"Locus  of  spatial-frequency  discrimination,"  J  Opt.  Soc.  Am.  A  4,  1807-1813,  1987. 

"Further  evidence  for  a  broadband,  isotropic  mechanism  sensitive  to  high-velocity 
stimuli,"  Vision  Res.  27,  9,  1527-1537, 1987,  with  D.H.  Kelly. 

B.  Manuscripts  Submitted 

"No  orientation  selectivity  in  large-scale  localization,"  submitted  to./.  Opt.  Soc.  Am.  A. 

"Large-scale  localization  across  spatial  frequency  channels,"  submitted  to  Vision  Res. 

"Serial  Stages  in  Spatial  Processing:  Evidence  from  Pattern  Adaption  Effects,"  to  be 
submitted  to  Vision  Res. 
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In  standard  frequency  discrimination  experiments  either  the  retinal  spatial  frequencies  (cycles  per  degree!  or  the 
object  spatial  frequencies  (real  world)  could  be  compared,  because  the  retinal  and  object  frequency  differences  are 
the  same.  Current  models  of  spatial  frequency  discrimination  assume  that  observers  compare  the  retinal  frequen 
cies.  1  test  this  assumption  by  presenting  gratings  at  different  viewing  distances  (with  strong  depth  cues)  The 
object  frequencies  of  the  gratings  bear  the  same  relationship  that  they  do  in  a  standard  frequency-discrimination 
experiment,  but  the  retinal  frequency  of  the  more  distant  grating  is  always  markedly  higher  than  that  of  the  near 
grating  The  observer's  task  is  to  compare  the  object  spatial  frequencies.  This  change  from  one  depth  to  two  (with 
no  change  in  the  stimulus  object)  has  a  negligible  effect  on  the  observer’s  performance,  suggesting  that  observers 
compare  object  frequencies  even  in  standard  spatiaJ-frequency-discrimination  experiments  This  conclusion  is 
supported  by  the  findings  that  (1)  observers  appear  unable  to  learn  to  compare  retinal  frequencies  and  (2)  the 
interstimulus  interval  has  no  effect  (over  the  range  0-1020  msec),  implying  long-term  storage  of  the  visual 
information.  Suggestions  are  made  about  why  these  results  are  consistent  with  good  system  design 


1.  INTRODUCTION 

In  recent  years,  spatial-frequency  discrimination  has  been 
gaining  popularity  as  a  tool  for  uncovecing  properties  of 
early  spatial  visual  processing.1  15  Its  primary  use  has  been 
in  testing  and  developing  models  of  spatial  vision  that  are 
based  on  multiple  size-tuned  or  multiple  spatial-frequency- 
tuned  channels.  These  channels  were  originally  postulated 
to  account  for  the  results  of  contrast-detection  experi¬ 
ments.7  9  They  were  subsequently  elaborated  to  account 
for  results  of  spatial-frequency-discrimination  studies1  ■*  un¬ 
der  the  hypothesis  that  discrimination  and  detection  consti¬ 
tute  different  decision  processes  on  the  same  neural 
representation.1 

The  most  well-developed  channel  models  of  frequency 
discrimination  are  those  of  Thomas'  and  of  Wilson  and 
Gelb.1  In  their  models,  a  grating  stimulus  is  represented  by 
the  output  of  some  number  of  spatial-frequency  channels. 
The  discriminability  of  two  gratings  is  then  modeled  as  a 
simple  function  of  the  differences  in  the  outputs  of  these 
channels.  Frequency-channel  models  have  successfully  ac¬ 
counted  for  a  considerable  range  of  results  (see  Ref.  10  for  a 
review),  but  they  have  not  addressed  all  the  relevant  and 
important  issues.  The  research  reported  here  considers  one 
basic  issue  that  has  not  been  discussed  in  the  literature:  the 
relationship  between  perceived  spatial  frequency  and  spa¬ 
tial-frequency  discrimination. 

Definitions  For  brevity,  the  spatial  frequency  of  a  stim  • 
ulus  image  on  the  retina,  measured  in  cycles  per  degree  of 
visual  angle,  is  referred  to  as  the  retinal  frequency.  The 
spatial  frequency  of  the  stimulus,  measured  in  cycles  per 
centimeter  in  the  stimulus  plane,  is  referred  to  as  the  object 
frequency.  The  perceived  spatial  frequency  is  the  observ¬ 
er's  estimate  of  the  object  frequency.  In  the  experiments 
reported  below,  the  observer  is  given  strong  cues  to  depth  so 
that,  over  the  range  of  viewing  distances  used,  the  perceived 
frequency  can  be  considered  to  be  a  good  estimate  of  the 
object  frequency. 

Perceived  frequency  varies  with  perceived  stimulus  depth 


in  the  same  way  that  the  perceived  size  of  an  object  does,1 1  1 
resulting  in  frequency  constancy,  which  is  analogous  (or 
identical)  to  size  constancy.111  However,  spatial-frequency 
discrimination  is  usually  modeled  in  terms  of  mechanisms 
that  are  insensitive  to  stimulus  depth.  Therefore,  if  current 
models  of  discrimination  are  basically  correct,  then  spatial 
frequency  discrimination  cannot  be  based  on  perceived  fre 
quency  but  must,  in  fact,  be  dissociated  from  that  percept 
Of  course,  perceived  frequencies  can  also  be  compared: 
therefore,  if  channel  models  are  correct,  there  must  be  some 
other  mechanism  for  that. 

Thus  a  channel-models  approach  implicitly  requires  two 
mechanisms  of  spatial-frequency  discrimination,  one  that 
compares  retinal  frequencies  and  one  that  compares  per 
ceived  frequencies.  Because  a  perceived -frequency  com 
parator  requires  more  information  than  a  retinal-frequency 
comparator  (namely,  stimulus  depth),  we  would  expert  the 
former  to  be  the  less  accurate  of  the  two  mechanisms  be 
cause  of  error  in  the  depth  estimate. 

In  the  experiments  reported  below,  I  search  for  evidence 
of  this  difference  but  find  none.  Instead,  I  obtain  essential 
Iv  the  same  psychometric  function  for  spatial  frequency  dis 
crimination  when  perceived  frequencies  are  compared  as 
when,  according  to  channel  models,  retinal  frequencies  are 
compared.  Even  conservative  estimates  of  the  error  in  the 
depth  judgment  suggest  that  the  two  functions  should  differ 
more  markedly.  The  most  parsimonious  explanation  of  the 
data  is  that  there  is  only  a  single  frequency  discrimination 
mechanism  and  that  this  mechanism  compares  (its  esti 
mates  of)  the  object  frequencies. 

2.  STANDARD  FREQUENCY 
DISCRIMINATION  VERSUS 
OBJECT-FREQUENCY  DISCRIMINATION 

Current  channel  models  of  spatial  frequency  discriminat ion 
assume  that  when  two  gratings  are  presented  consecutively 
at  a  single  viewing  distance,  as  thev  are  in  standard  frequen 
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cy  discrimination  tasks,  observers  compare  their  retinal  fre¬ 
quencies.  This  assumption  can  be  tested  by  comparing  the 
psychometric  functions  for  frequency  discrimination  ob¬ 
tained  (1)  under  standard  single-viewing-distance  condi¬ 
tions  and  (2)  under  conditions  in  which  the  observer  is  re¬ 
quired  to  compare  the  object  frequencies  of  gratings  pre¬ 
sented  at  different  viewing  distances.  Although  a 
mechanism  that  compares  retinal  frequencies  could  theoret¬ 
ically  be  responsible  for  performance  in  the  standard  single¬ 
distance  case,  it  cannot  alone  account  for  object-frequency 
|  discrimination  because  that  requires  depth  information. 

,  Therefore,  if  a  retinal-frequency  comparator  is  responsible 

i  for  standard  spatial-frequency  discrimination,  then  a  differ- 

|  ent  mechanism  must  be  responsible  for  object-frequency 

*  discrimination.  If  there  are  two  such  distinct  mechanisms, 

’  they  should  yield  different  psychometric  functions  because 

an  object-frequency  comparator  must  contend  with  noise  in 
the  depth  estimate  whereas  a  retinal-frequency  comparator 
need  not.  The  following  experiments  test  this  implication 
of  channel  models  of  frequency  discrimination. 

i  Methods 

The  author  and  a  naive  subject  served  as  observers  in  this 
experiment.  Other  naive  observers  were  used  in  experi- 
I  ments  reported  below.  All  observers  had  normal  or  correct- 

'  able-to-normal  vision  and  ample  accommodative  range  for 

,  the  experimental  conditions. 

,  Stimuli 

Horizontal  grating  stimuli  were  displayed  on  two  monitors 
it'onrac  2900  09  black-and-white  monitors  with  512  pixels 
X  512  pixels  and  a  60-Hz  noninterlaced  frame  rate).  The 
|  displays  were  41  cm  X  29  cm.  including  a  2-cm  mean  lumi- 

i  nance  border  on  all  four  sides.  The  stimulus  portion  of  the 

screens  thus  subtended  approximately  21  deg  X  15  deg  at  1 
in  and  11  deg  X  8  deg  at  2  m.  Control  experiments  were 
performed  in  which  the  angular  diameter  of  the  display  (as 
measured  at  the  retina)  was  the  same  for  the  1-  and  2-m 
'  conditions.  This  manipulation  had  no  measurable  effect  on 

I  the  observer's  performance. 

,  The  mean  luminance  of  each  monitor  was  79  cd/m-.  Mi- 

■  crocomputers  and  associated  interface  hardware  generated 

the  stimuli,  randomized  the  order  of  presentation,  and  re¬ 
corded  the  data.  Gamma  correction  was  performed  by  an 
electronic  circuit  tailored  to  the  display's  characteristics.  In 
'  the  contrast  range  used,  luminances  were  within  2°i  of  the 

,  theoretical  values. 

'  The  contrast  of  each  grating  was  varied  randomly  from 

,  trial  to  trial  in  the  range  of  40-60wr  modulation,  and  the 

phase  of  each  grating  relative  to  the  display  surround  was 
also  varied  randomly  from  trial  to  trial  in  the  range  0-90 deg 
in  order  to  prevent,  the  use  of  contrast  or  relative  phase  as  a 
,  cue  to  frequency. 

'  In  the  standard  frequency  discrimination  experiments. 

,  the  gratings  were  presented  on  a  single  screen,  located  2  m 

from  the  observer  tSome  experiments  were  also  conducted 
with  the  screen  at  1  m  No  significant  effect  of  viewing 
distance  was  found  I  Viewing  was  monocular,  and  the  room 
[  w a s  otherwise  dark,  to  replicate  conditions  tvpically  used  in 

-p.itial  trcqnencv  discrimination  experiments.  The  mean 
1  retinal  (requeues  was  8  |  cycles  deg.  which  corresponds  to 

!  i  si  les  cm  at  the  2  nt  viewing  distance 
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For  the  object-frequency  comparisons,  one  display  screen 
was  located  at  1  m  and  the  other  at  2  m  from  the  observer. 
Viewing  was  binocular,  and  the  room  was  dimly  lit  (~3  cd/ 
m2)  to  facilitate  acquisition  of  depth  information  without 
significantly  reducing  t.  a  contrast  of  the  stimulus  on  the 
display.  Figure  1  shows  the  depth  cues  available  to  the 
observer.  (The  room  illumination  was  increased  to  obtain  a 
photograph  that  would  reproduce  well.)  The  pair  of  object 
stimuli  presented  in  each  trial  was  identical  to  that  present¬ 
ed  in  the  standard  frequency-discrimination  experiment. 
Feedback  was  also  identical.  However,  in  a  given  trial,  one 
grating  was  presented  on  the  1-m  screen  and  the  other  was 
presented  on  the  2-m  screen.  The  gratings  were  presented 
sequentially,  as  in  the  previous  experiment.  Because  the 
viewing  distances  to  the  two  displays  differed  by  a  factor  of 
2,  the  retinal  frequencies  of  the  gratings  differed,  on  average, 
by  a  factor  of  2.  The  observer’s  task  was  to  determine  which 
grating  of  the  pair  had  the  higher  object  frequency. 

Procedure 

The  method  of  constant  stimuli  was  used.  Each  trial  con¬ 
sisted  of  an  if  +  nA//2,  f  -  nSf/2)  pair,  where  /  is  the  mean 
object  frequency  of  the  experiment,  A/  equals  1%  of  the 
mean  frequency,  and  n  is  an  integer  from  1  to  8.  The  two 
gratings  were  presented  sequentially  on  each  trial.  At  the 
observer’s  initiation,  the  first  grating  appeared  for  204  msec 
with  abrupt  onset  and  abrupt  termination.  At  1020  msec 
after  the  termination  of  the  first  grating,  the  second  grating 
was  presented  with  the  same  temporal  waveform  as  the  first. 
The  delay  between  presentations  gave  the  observer  time  to 
saccade  from  one  display  to  the  other  and  to  change  accom¬ 
modation  appropriately  when  the  displays  were  at  different 
viewing  distances.  The  effect  of  the  interstimulus  interval 
(ISI)  was  considered  in  subsequent  experiments. 

During  each  experimental  session,  each  grating  pair  was 
presented  10  times  in  random  order.  In  half  of  the  trials,  the 
higher-frequency  grating  was  presented  in  the  first  interval, 
and  in  half  of  the  trials  it  was  presented  in  the  second.  The 
subject's  task  was  to  indicate  during  which  interval  the  grat 


Fig  I  Photograph  of  laboratory',  showing  arrangement  of  displays 
and  surrounding  depth  inlormation  I  he  room  illumination  shown 
is  considerably  higher  than  that  used  m  the  object  frequence  dis 
crimination  experiments  isee  the  text!,  but  the  photograph  an  u 
ratelv  represents  the  visual  information  available  to  the  observer 
— For  the  observer,  there  was  no  lateral  gap  visible  between  the  two 
displays 
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Fig  2.  Psychometric  functions  for  frequency  discrimination.  The 
two  gratings  that  constituted  a  trial  were  presented  sequentially 
either  on  one  screen  located  at  2  m  (filled  circles)  or  on  different 
screens  located  at  1  and  2  m  from  the  observer  (open  circles).  The 
object  stimuli  were  identical  in  the  two  experiments;  the  distances 
to  the  screens  and  the  retinal  frequencies  differed.  Observers  were 
JDC (A) and  CAB (B) 
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Fig  2.  Best-fitting  lines  to  the  linearized  psychometric  functions 
for  standard  frequency  discrimination  (solid  lines)  and  for  object- 
spatial  frequence  discrimination  (dotted  lines).  Observers  were 
-IDC  l  A)  and  CAB  (B). 

ing  of  higher  object  frequency  appeared.  This  task  was 
unambiguous  because  there  was  only  one  way  of  seeing  the 
gratings;  observers  could  not  simply  choose  to  ignore  the 
depth  cues  (see  Sections  5  and  6).  Right-wrong  feedback 
was  given  after  each  trial,  and  enough  practice  trials  were 
conducted  to  ensure  that  the  observer’s  performance  had 
reached  a  plateau. 

The  data  were  adjusted  for  guessing  as  follows:  (original 
percent  correct  -  '»(>)  X  2  =  adjusted  percent  correct. 

Results 

Results  of  the  standard  spatial  frequency-discrimination 
experiments  are  shown  by  the  filled  symbols  in  Fig.  2.  Fre¬ 
quency  discrimination  thresholds  (determined  by  standard 
probit  analysis  techniques)14  were  2.6  and  3.9°^  for  observers 
•IIH  and  CAR.  respectively  These  thresholds  are  consis¬ 
tent  with  values  obtained  previously.1'' 

Data  tor  ob|ect  frequency  discrimination  are  shown  by 
the  open  symbols  in  Fig  2  There  is  no  obvious  difference 
between  the  psychometric  functions  for  standard  frequency 
discrimination  ( filled  symbols)  and  for  object  -  frequency  dis 
crimination,  but  there  is  a  small  tendency  for  accuracy  to  be 
higher  for  standard  frequency  discrimination  To  illustrate 
this  more  clearly,  the  individual  psychometric  functions 
were  linearized  by  converting  the  percentages  to  probits14 
and  then  were  summarized  by  the  best  fitting  lines  These 
lines  are  shown  in  Fig  :(  The  object  discrimination  turn 
turn  (dotted  line)  lies  slightly  below  the  standard  frequency 
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discrimination  function  (solid  line)  This  small  difference 
could  readily  be  accounted  for  by  the  fact  that  the  error--  in 
two  estimates  of  a  single  depth  (standard  discrimination! 
are  undoubtedly  more  highly  correlated  than  are  the  error- 
in  the  estimates  of  two  depths  (object  discrimination ) 

Discussion 

The  small  differences  in  the  data  reported  above  do  not 
support  the  hypothesis  that  there  are  two  distinct  underlv 
ing  mechanisms.  Without  strong  evidence  for  two  media 
nisms,  only  a  single  mechanism  should  be  assumed,  simple 
on  the  basis  of  parsimony.  However,  one  can  also  consider 
whether  a  stronger  inference  can  be  made  from  these  data 
It  was  argued  above  that  the  psychometric  function  for  oh 
ject-frequency  discrimination  should  differ  from  that  for 
retinal-frequency  discrimination  The  question,  ol  course, 
is  how  different  it  should  be.  Specifically,  do  the  data  re 
ported  above  actually  contradict  the  hypothesis  that  ret  trial 
frequencies  are  being  compared  in  the  standard  spatial 
frequency-discrimination  task0  To  answer  this  question,  a 
quantitative  theoretical  assessment  of  the  effect  of  depth 
error  on  the  psychometric  function  for  frequence  discrinu 
nation  is  required. 

3.  EXPECTED  EFFECTS  OF  ERROR  IN  THE 
DEPTH  JUDGMENT 

The  two  most  plausible  explanat  ions  for  the  data  rep< >rted  m 
Section  2  are  that  both  tasks  are  mediated  by  a  common 
mechanism  that  is  sensitive  to  depth  and.  alternat ively.  thu> 
they  are  mediated  by  different  mechanisms  but  the  addi 
tional  error  introduced  by  the  depth  judgment  'required  m 
object -frequency  discrimination)  is  so  small  that  it  make- 
only  a  slight  change  in  the  psychometric  function  for  frt 
quency  discrimination.  To  assess  the  plausibility  of  thi- 
small-depth  error  explanation,  the  following  quantitative 
analysis  was  performed 

For  this  analysis,  it  was  assumed  that  the  error  in  the 
retinal-frequency  representation  is  given  by  the  results  of 
the  standard  frequency  discrimination  experiments  This 
assumption  has  also  been  made  for  channel  models  of  Ire 
quency  discrimination  Several  estimates  of  the  dejit  h  error 
were  then  made  to  determine  the  magnitude  of  the  error  that 
would  be  consistent  with  the  object  frequency-discrimma 
lion  data  (Figs.  2  and  .'ll  under  the  assumption  that  perfor 
mance  in  object-frequency  discrimination  is  limited  only  by 
the  accuracy  of  the  retinal  frequency  and  depth  information 
A  Gaussian  probability  density  function  was  used  for  the 
depth-error  estimate,  with  n  being  changed  to  obtain  the 
different  estimates.  The  mean  was  assumed  to  be  zero, 
consistent  with  size  constancy  The  depth  information  that 
the  observer  need-  to  discriminate  between  object  trequen 
cies  is  the  ratio  of  the  two  viewing  distances  There  are  in 
data  in  the  literature,  of  which  1  am  aware,  that  pertain  to 
this  point,  and  our  laboratory  conditions  were  not  suitable 
for  making  this  measurement  (because  of  the  large  number 
of  depth  cues).  Therefore  we  consider  several  value-  of  ,- 

The  estimated  effeits  of  depth  error  were  calculated  a- 
foi low s  the  probability  of  a  correct  response  tor  a  given  A'  ' 
is  the  product  of  the  probability  of  a  correct  response  in  tic 
absence  of  depth  error  Me.  the  value  from  the  -i.md.it  I 
frequency  discrimination  experiment'  multiplied  In  I  he 
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Fig  4  Kffect  of  adding  error  from  a  depth  estimate  to  the  psycho¬ 
metric  function  obtained  in  the  standard  frequency -discrimination 
experiments.  An  estimate  of  the  psychometric  function  resulting 
from  adding  a  depth  judgment  to  the  spatiai-frequency-discrimina- 
tion  process  is  shown  (bold  lines).  The  probability-density  func¬ 
tion  of  depth  error  is  Gaussian  with  a  =  3%  (see  the  text).  Results  of 
standard  frequency  discrimination  experiments  (filled  symbols) 
and  object  frequency  discrimination  experiments  (open  symbols) 
are  also  shown.  Observers  were  4DC  (A)  and  CAB  (B). 
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Fig  i  Same  as  Fig.  4  except  that  a  for  the  depth  error  is  1%. 

lone-tailed)  probability  that  the  depth  error  would  exceed 
A/./  percent.  (A  depth  error  of  n%  or  more,  in  the  appropri¬ 
ate  direction,  would  reverse  the  observer's  judgment  if  the 
frequency  difference  was  n%  or  less.) 

Figure  4  (bold  lines)  shows  the  results  of  including  a  a  =  3% 
depth  error  in  the  psychometric  function  for  frequency  dis¬ 
crimination.  (Although  this  error  is  larger  than  the  lowest 
obtained  with  some  stereo  paradigms, IH  it  should  be  consid¬ 
ered  because  our  viewing  situation  was  not  designed  to  elicit 
stereo  hyperacuity.)  The  effects  of  depth  error  were  calcu¬ 
lated  separately  for  each  observer.  Also  shown  for  compari¬ 
son  are  the  original  psychometric  functions  for  standard 
frequency  discrimination  and  object-frequency  discrimina¬ 
tion  (filled  and  open  symbols,  respectively).  For  both  ob¬ 
servers,  the  standard  frequency-discrimination  function 
with  ( n  =  ;t)  error  added  differs  substantially  from  the  ob¬ 
its  t  frequency  discrimination  function.  The  largest  differ¬ 
ence  occurs  at  small  values  of  A///  because  when  A///  i» 
'mail,  even  small  depth  errors  can  affect  the  results,  whereas 
w hen  A/> /  is  large,  onlv  large  depth  errors  have  an  effect. 

In  the  next  estimate,  a  is  assumed  to  he  1 .  The  effects  of 
i  hi'  dept  h  error  are  shown  in  Fig.  5  for  both  observers.  With 
'  =  I  the  depth  error  added  and  object  frequency-dis- 
-  rnnm.it  ion  (unctions  are  clearly  different  at  the  low  end  for 
one  oh'erwr  |Fig  lint  not  for  the  other  [Fig.  5(B)), 

Is.  iiise  the  second  observer  s  low  accuracy  at  the  smallest 
.  lines  o|  \f  /  ton  es  t he  curves  to  come  together.  For<r<l, 

• 1  .  diMcrem  es  ire  not  significant  lor  eit her  observer. 

It  •  lor  i he  dept h  error  under  t he  experimental  conditions 

•  !  to  r.  -  more  iti. m  ili< ait  1'  (.  then  the  data  contradict  . 

A- 


the  hypothesis  that  retinal  frequencies  are  being  compared 
in  standard  frequency  discrimination.  If  a  for  the  depth 
error  is  less  than  about  1%,  then  these  results  would  be 
consistent  with  either  a  single-mechanism  explanation  (ob¬ 
ject  frequencies  compared)  or  with  a  two-mechanism  expla¬ 
nation  (object  or  retinal  frequencies  compared).  However, 
even  if  the  depth  error  were  that  small,  the  null  hypothesis — 
that  there  is  only  one  mechanism  for  frequency  discrimina¬ 
tion — should  still  be  assumed  in  the  absence  of  positive 
evidence  for  a  second  mechanism.  I  therefore  assume  that 
in  the  standard  spatial-frequency-discrimination  experi¬ 
ment  described  in  Section  2,  the  observers  actually  com¬ 
pared  estimates  of  object  frequencies.  That  conclusion  is 
tested  further  in  the  following  sections. 

4.  EFFECT  OF  INTERSTIMULUS  INTERVAL 

in  the  experiments  reported  in  Section  2  a  long  ISI  was  used 
to  provide  the  observer  with  time  to  shift  between  the  two 
stimulus  depths  in  the  object-frequency-discrimination 
task.  However,  the  long  ISI  makes  the  results  difficult  to 
relate  to  previous  studies  of  frequency  discrimination,  in 
which  shorter  ISI’s  have  generally  been  used.  Furthermore, 
one  might  expect  the  sensitivity  of  more  primitive  spatial- 
frequency  representations  to  be  revealed  if  the  ISI  were 
reduced.  Long  ISI’s  might  favor  comparison  of  the  object 
frequencies,  and  shorter  ISI’s  might  favor  the  comparison  of 
retinal  frequencies.  In  the  following  experiments,  frequen¬ 
cy-discrimination  thresholds  were  measured  as  a  function  of 
ISI  by  using  a  single-screen  (single-distance)  paradigm. 

Methods 

The  experimental  procedure  used  in  these  experiments  was 
similar  to  that  used  in  the  standard  frequency-discrimina¬ 
tion  experiment  (Section  2)  except  that  the  duration  be¬ 
tween  the  two  grating  presentations  was  varied  between 
experimental  sessions.  The  relative  phases  of  the  gratings 
were  randomized  from  trial  to  trial.  The  ISI’s  were  0,  85. 
255, 510  and  1020  msec.  Each  grating  was  presented  for  204 
msec.  Viewing  distance  was  1  m.  and  the  mean  spatial 
frequency  was  1.36  cycles/deg  at  the  retina.  Viewing  was 
monocular.  Two  naive  observers  were  used,  neither  of 
whom  had  served  in  the  previous  experiments. 

Results 

Frequency-discrimination  thresholds  for  all  lSFs  and  both 
observers  are  shown  in  Fig.  6.  Although  both  observers 
show  some  variation  across  this  large  range  of  ISI’s,  the 
variation  is  not  systematic  across  observers.  The  individual 
psychometric  functions  underlying  these  thresholds  are 
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Fig  7.  Psychometric  functions  for  frequency  discrimination  un 
deriving  the  thresholds  shown  in  Fig  6,  for  observers  MBO  ( A I  and 
EBF  <B)  The  two  extreme  ISI's  are  shown  on  the  right  0  msec 
(open  circles)  and  1020  msec  (filled  circles)  The  three  intermedi 
ate  ISI's  are  shown  on  the  left  510  msec  (opei  circles).  255  msec 
(filled  circles),  and  85  msec  (filled  squares) 

shown  in  Fig.  7.  Frequency-discrimination  thresholds  do 
not  vary  systematically  with  IS1  over  the  range  from  0  to 
1020  msec.  In  particular,  there  is  no  evidence  that  the 
longest  ISI  taps  a  different  mechanism  than  briefer  ISI's. 
Thus  the  standard  spatial-frequency-discrimination  task 
(Section  2)  was,  in  fact,  representative.  These  results  repli¬ 
cate  and  extend  the  results  of  Regan’s  study17  in  which 
frequency-discrimination  thresholds  were  measured  with 
ISI’s  ranging  from  0.4  to  20  sec. 

Discussion 

The  study  noted  earlier17  on  the  effect  of  ISI  on  spatial- 
frequency  discrimination  focused  on  the  storage  of  spatial 
frequency  information.  This  view  of  the  results  of  the  ISI 
manipulations  is  particularly  interesting  in  the  present  con¬ 
text.  The  results  reported  in  Section  2  suggest  that  it  is  the 
object  frequency,  not  the  retinal  frequency,  that  is  stored. 
At  very  long  ISI's  (i.e.,  several  seconds),  intuition  supports 
the  idea  that  only  the  object -frequency  information  would 
remain  The  interesting  result  is  that  this  effect  appears  to 
hold  also  when  the  two  gratings  are  presented  in  immediate 
succession.  The  results  of  the  ISI  manipulations  and  the 
comparison  of  standard  frequency-discrimination  results 
with  object  frequency-discrimination  results  thus  point  to 
the  primacy  of  an  object  frequency  representation  in  spa 
tial  frequency  discrimination  tasks. 

5.  RETINAL-SPATIAL- FREQUENCY 
DISCRIMINATION 

1  he  data  obtained  thus  far  suggest  that  under  standard 
experimental  conditions,  observers  compare  the  object  fre¬ 


quencies  and  not  the  retinal  frequencies  of  the  gratings,  even 
though  the  representation  of  the  object  frequencies  must 
include  more  error  than  does  the  representation  of  the  reti 
nal  frequencies.  A  logical  question  is  whether  the  observer 
can  learn  to  access  the  retinal-frequency  representation  di 
rectly.  The  aim  of  the  following  experiment  was  to  try  to 
teach  observers  to  compare  retinal  frequencies  directly. 

Methods 

The  gratings  were  presented  at  different  viewing  distances 
(1  and  3  m)  and  were  paired  according  to  their  retinal  fre¬ 
quencies,  making  their  object  frequencies  differ  by  about  a 
factor  of  3.  The  average  retinal  frequency  was  4.05  cycles/ 
deg  (which  was  2.32  cycles/cm  on  the  1-m  screen).  The 
observer’s  task  was  to  indicate  which  display  had  the  grating 
of  higher  retinal  frequency.  Auditory  feedback  was  used  to 
define  the  task,  as  it  was  in  all  previous  experiments.  Rath 
er  than  presenting  grating  pairs  that  shared  a  common  mean 
frequency  in  this  experiment,  I  presented  grating  pairs  that 
had  different  mean  frequencies.  A f/f  was  fixed  at  10r< 
(This  paradigm  was  used  to  prevent  the  observer  from  mak 
ing  judgments  by  comparing  the  frequency  of  one  of  the 
gratings  with  the  average  frequency  previously  presented  i  >n 
that  screen.)  This  experiment  was  otherwise  identical  to 
the  object-frequency  discrimination  experiments  reported 
in  Section  2. 

The  observer  whose  data  are  shown  was  completely  inex 
perienced  with  this  and  related  tasks  She  had  not  served  m 
any  of  the  previous  experiments  and  was  not  informed  of  the 
results  of  those  experiments  until  all  data  were  collected 
Her  only  instructions  were  to  be  correct  as  often  as  possible 
Other  observers  were  told  to  try  to  ignore  the  distances  to 
the  screens.  Their  performance  was  no  better 

Results 

Frequency-discrimination  thresholds  for  this  retinal  fre 
queney  discrimination  and  for  an  associated  object  frequen 
cy  discrimination  (same  viewing  distances;  average  object 
frequency,  2.32  cycles/cm  I  are  shown  in  Fig  8.  I’erfnrmam  e 
on  this  task  was  initially  very  poor,  but  it  improved  with 
practice  until  it  nearlv  equaled  that  obtained  bv  this  observ 
er  for  object,  frequency  discrimination 
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Fig  8  Effects  of  learning  on  frequence  discrimination  with  Mew 
trig  distances  of  1  and  3  m  for  observer  \T  Result'  for  retinal 
frequemy  discrimination  tfilled  circles)  and  object  (requeues  dis 
crimination  (open  circles)  are  shown  Each  datum  represent'  the 
re'll  1 1  of  one  session  of  80  trials  In  these  experiments.  A/  /  was 
fixed  at  1  Ob  .  and  t  he  center  frequency  /  was  varied  This  paradigm 
yields  higher  overall  thresholds  but  ensure'  that  the  observer  does 
not  make  same  screen  comparisons 
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Discussion 

One  might  conclude  from  these  data  that  an  observer  can 
eventually  learn  to  ignore  depth  and  to  compare  retinal 
frequencies  directly.  However,  two  problems  stand  in  the 
way  of  this  interpretation.  First,  if  the  observer  is  compar¬ 
ing  retinal  frequencies  directly,  then  he  or  she  should  be 
more  accurate  at  this  task  than  at  object-frequency  discrimi¬ 
nation.  However,  none  of  the  four  observers  who  participat¬ 
ed  in  this  portion  of  the  study  was  more  accurate  at  the 
retinal-frequency  discrimination.  Second,  there  is  another 
means  by  which  the  observer  could  be  performing  this  task: 
the  object  frequencies  of  the  two  gratings  differ  by  approxi¬ 
mately  a  factor  of  3.  This  ratio  is  more  than  3  if  the  far 
screen  has  the  lower  retinal  spatial-frequency  grating  and  is 
less  than  3  if  the  near  screen  has  it.  Thus  the  observer  needs 
only  to  compare  the  ratios  of  the  object  frequencies  with  the 
average  objective-frequency  ratio  to  obtain  the  required  an 
swer.  All  four  observers  who  were  trained  on  the  retinal- 
frequencv-discrimination  task  independently  reported 
adopting  this  strategy. 

6.  FREQUENCY-RATIO  DISCRIMINATION 

Ihe  informal  observations  made  in  the  retinal  frequency 
discrimination  experiments  were  tested  and  confirmed  ex¬ 
perimentally  as  follows.  After  the  observer  mastered  the 
ret  inal  frequency-discrimination  task,  the  viewing  distances 
were  changed  while  the  stimulus  objects  remained  the  same 
Bei  arise  the  object  frequencies  were  unchanged,  their  aver¬ 
age  ratio  was  also  unchanged  However,  because  the  view¬ 
ing  distances  were  changed,  the  retinal  frequencies  were  now 
related  by  an  arbitrary  ratio  The  auditors-  right  wrong 
feedback  to  the  observer  was  also  unchanged  Therefore  the 
observer's  task  was  the  same  as  in  the  previous  experiment 
when  considered  in  terms  of  the  object  frequencies  but  be 
■  ame  arbitrary  when  considered  in  terms  of  the  retinal  fre¬ 
quent  ies  It  the  observer  were  actually  comparing  retinal 
trequencies  in  the  retinal  frequency-discrimination  experi¬ 
ment.  then  he  or  she  should  initiallv  be  at  a  loss  about  how  to 
perform  this  frequency  ratio  discrimination  However,  if 
the  observer  were  comparing  the  ratios  of  the  object  fre 
quencies  in  the  retinal -frequency  discrimination  task,  then 
the  i  hange  in  viewing  distance  should  have  no  effect  on  his 
or  her  performance 

Methods 

I  he  experimental  conditions  were  the  same  as  those  used 
prev  louslv  i  Sect  ion  2 1  except  that  t  he  viewing  distances  were 
I  and  2  m  for  the  retinal  frequency  discrimination  that 
-erved  as  the  control  and  the  2  m  screen  was  moved  to  1.5  m 
tor  the  frequence  ratio  discrimination.  At  the  1  and  2-m 
viewing  distances,  the  average  retinal  frequency  was  4.05 

i  v  i  ies  deg. 

Results 

Figure  9  i tilled  circles)  shows  data  obtained  in  the  frequency- 
ratio  discrimination  experiment  without  practice.  Also 
-bown  for  comparison  (open  symbols)  are  data  from  the 
retinal  frequency  discrimination  experiment,  obtained  af 
ter  a  stable  level  of  performance  had  been  reached.  The 
observer  performed  the  frequency  ratio  discrimination  as 
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Fig  9  Psychometric  functions  for  frequency  ratio  discrimination 
Hilled  circles)  and  retinal  frequence  discrimination  (open  circles! 
lor  observer  II  It ' 

well  as  he  performed  the  retinal  frequency  discrimination. 
Furthermore,  the  learning  transferred  completely  from  reti¬ 
nal  frequency  discrimination  to  frequency -ratio  discrimina¬ 
tion.  Performance  on  the  frequency  ratio  discrimination 
began  at  the  high  level  of  accuracy  shown  here  even  though 
the  relationship  between  the  retinal  frequencies  was  arbi¬ 
trary  Thus  it  seems  c  lear  that  observers  did  not  compare 
ihe  retinal  trequencies  in  the  original  task  but  instead  com¬ 
pared  estimates  of  the  object  frequencies  of  the  gratings. 

7.  DISCUSSION 

The  data  reported  here  do  not  support  the  hypothesis  that 
observers  compare  retinal  frequencies  directly  in  standard 
spatial  frequency  discrimination  xperiments.  Instead, 
observers  appear  to  compare  estimates  of  object  frequencies 
even  when  the  r^t inal  frequencies  are  similar  and  the  object 
frequencies  are  dissimilar.  This  conclusion  contradicts  the 
basic  assumption  of  current  spatial  frequency-channel  mod¬ 
els  of  frequency  discrimination.  The  reliance  of  spatial- 
frequency  discrimination  on  an  estimate  of  stimulus  depth 
as  well  as  on  the  retinal  frequencies  implies  that  frequency 
discrimination  cannot  be  performed  at  the  theoretical  fre¬ 
quency  channels  stage  of  processing.  It  also  suggests  that 
discrimination  and  detection  do  not  "involve  the  application 
ol  different  decision  processes  to  the  same  neural  represen¬ 
tation  of  the  v  isual  scene"1'1  but  instead  are  based  on  funda¬ 
mentally  different  representations  that  may  be  serially  re¬ 
lated 

I  he  idea  that  detection  threshold  and  perceived  frequen¬ 
cy  are  based  on  different  neural  representations  was  previ¬ 
ously  proposed  by  Klein  i  t  n/.!'  l  sing  an  adaptation  para 
digm,  they  found  that  perceived  spatial  frequency  shifts  in 
the  same  wav  when  the  test  stimulus  is  surrounded  bv  a 
simultaneous  grating  annulus  set  at  the  adapting  frequency 
as  it  does  when  the  test  stimulus  is  preceded  bv  adaptation 
to  a  grating  stimulus  that  covers  the  test  area.  Detection 
thresholds,  on  the  other  hand,  are  unaffected  bv  the  pres 
ence  of  the  surrounding  annulus  but  are  raised  it  preceded 
by  adaptation  to  a  superimposed  grating  <>t  similar  spatial 
frequency  Klein  et  al  concluded  from  these  results  that 
contrast  threshold  elevation  and  the  peneived  spatial  Ire 
quenev  shift  arise  from  adaptation  at  dilferent  -lies  in  tin 
v isual  pathway  ( '.rahanv  ’  has  also  noted  disi  repa tines  be 
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tweert  the  results  of  detection  and  identification  experi¬ 
ments 

The  idea  that  frequency  discrimination  occurs  subsequent 
to  the  frequency-channels  stage  (a  two-stage  model)  is  not 
contradictory  to  experimental  results  that  have  been  cited  as 
evidence  for  the  spatial-frequency-channels  model  of  fre¬ 
quency  discrimination.  The  strongest  argument  for  a  single 
stage  for  detection  and  discrimination  is  the  finding  that  the 
ratio  of  z  scores  for  identifiability  and  detectability  remains 
constant  as  the  contrast  of  the  grating  is  changed  in  the  near¬ 
threshold  region. J0  Although  this  linkage  has  been  thought 
to  imply  that  detection  and  discrimination  occur  at  a  com¬ 
mon  site,  in  fact  the  contrast  result  implies  only  that  the 
effect  of  contrast  on  frequency  discrimination  can  be  com- 
pletelv  accounted  for  by  the  effect  of  contrast  at  the  detec¬ 
tion  stage  of  processing  This  conclusion  is  consistent  with  a 
two-stage  modei  in  which  spatial-frequency  discrimination 
is  based  on  representations  of  both  the  retinal  frequencies  of 
the  gratings  < at  the  purported  detection  stagel  and  their 
depths  The  accuracy  of  the  retinal-frequency  information 
is  affected  by  stimulus  contrast:  the  accuracy  of  the  depth 
information,  for  these  grating  stimuli,  is  not.  Therefore, 
even  in  a  two-stage  model,  the  only  effect  of  contrast  on 
frequency  discrimination  is  its  effect  on  the  retinal-frequen¬ 
cy  representation,  that  is,  on  the  detection  stage  in  current 
channel  models 

Other  evidence  cited  in  favor  of  a  single  site  of  detection 
and  discrimination1'  is  the  existence  of  multiple,  tuned 
pathways  and  pathway  labeling  Neither  of  these  concepts 
conflicts  with  the  idea  that  discrimination  occurs  at  a  site 
subsequent  to  detection.  The  information  may  be  transmit¬ 
ted  along  the  multiple,  tuned,  labeled,  pathways  and  then 
used  for  spatial  frequency  discrimination  at  a  later  site,  in 
conjunction  with  other  visual  information. 

The  results  and  conclusions  reported  here  are  also  not 
inconsistent  with  the  observation  of  Hirsch  and  Hylton*’1 
that  frequency-discrimination  accuracy  is  limited  by  the 
loveal  mosaic  -lust  as  the  accuracy  of  the  retinal-frequency 
representation  limits  the  accuracy  with  which  object  fre 
quencies  can  be  estimated,  so  the  receptor  mosaic  may  im- 
|>' >se  its  limitations,  w Inch  carrv  through  to  higher  perceptu¬ 
al  levels 

Fmallv.  it  is  interesting  to  note  that  the  psychometric 
function  for  spatial  (requeues  discrimination  shows  re 
markable  insensitivity  to  the  detailed  spatial  and  temporal 
mnd  it  ions  of  the  stimulus  presentations  that  so  affect  detec - 
t ion  thresholds  Frequence  discrimination  thresholds  are 
inseii'U  is  e  to  sue  h  basic  si  imuliis  parameters  as  the  relative 
distant  es  to  the  grating*,  being  compared,  the  mean  frequen¬ 
ce  ol  the  experiment.-  the  I S 1 . 1  and  the  relative  orienta 
lion-  of  tin  stiinuo  1  hi-  iii'ciisi'  is  it  v  is  consistent  with 
fhi  idea  presented  here  that  -pit:  d -frequency  discrimina 
tion  is  based  on  i  more  sophisticated  representation  of  the 
stimuli  than  is  coinnionlv  assumed  Although  this  conclu 
'  i  >  'll  contradicts  current  i  liamiel  models,  it  has  intuitive 
appeal  I  he  ultimate  goal  of  the  visual  svstem  is  to  gather 
ml  or  m.  if  ion  a  In  ml  f  he  external  w  orld.  and  uhiect  not  ret  i 
in !  f requei n  v  i~  t he  .  cm  of  that  realm 
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Abstract— The  frequency-channel  model  and  the  position,  or  "local-s.gns."  model  that  have  been 
proposed  to  account  for  hyperacuily  (i.e  small-scale  relative  spatial  localization)  are  examined  in  the 
context  of  large-scale  relative  spatial  localization  As  a  basis  for  subsequent  experiments,  localization 
accuracy  is  measured  over  a  large  range  of  object  separations,  and  previous  findings  that  the  "Weber 
fraction  for  localization"  is  constant  are  replicated  The  effects  on  localization  accuracy  of  both  high-  and 
low-spatial  frequency  components  in  the  objects  being  localized  are  examined  in  some  detail  Localization 
accuracy  is  found  not  to  rely  exclusively  on  either  the  high-  or  the  low-frequency  components  Neither 
the  frequency-channel  nor  the  position  hypothesis  as  defined  here  is  consistent  with  all  of  the  observed 
results  However,  with  a  slight  modification,  the  position  hypothesis  can  account  qualitatively  for  all  of 
the  observed  results,  whereas  no  reasonable  modification  of  the  frequency-channel  hypothesis  appears  able 
to  do  as  well 

Position  Spatial  frequency  channels  Spatial  vision  Contrast  Localization 


I.  INTRODUCTION 

At  its  finest,  the  human  visual  system  can  detect  Historically,  hyperacuity  has  been  analyzed  in 
a  few  photons,  a  few  tenths  of  a  percent  of  terms  of  the  nature  of  the  encoding  of  local 
contrast,  a  nanometer  shift  in  wavelength,  or  a  position  information  The  first  prominent  the- 
second  of  arc  displacement  (Hecht  el  al .,  1942;  ory  of  localization,  suggested  by  Lotze  and  then 
Van  Nes  and  Bouman,  1967;  Wright,  1946;  advocated  by  Hering  (described  in  Matin,  1972) 
Klein  and  Levi,  1985)  Such  abilities  are  im-  was  the  theory  of  local  signs.  In  this  theory, 
prcssive,  and,  as  visual  scientists,  we  are  eager  to  components  of  the  stimulus  excite  receptors, 
understand  them,  but  they  may  not  exemplify  which  signal  their  positions  relative  to  the  fovea, 
the  basic  visual  functions  that  underlie  our  more  These  retinal  positions  arc  then  compared  to 
mundane  perceptions  yield  judgments  about  the  relative  positions  of 

Research  on  relative  spatial  localization  (that  various  stimulus  components  Although  this 
is,  detection  of  the  position  of  objects  relative  to  model  and  its  subsequent  modifications  have 
one  another)  has  usually  focused  on  the  upper  been  invoked  primarily  to  account  for  hyper- 
limit  of  visual  performance.  The  ability  to  delect  acuity  thresholds  (Marshall  and  Talbot,  1942. 
offsets  that  are  less  than  the  width  of  a  retinal  Hirsch  and  Hylton,  1982)  they  could  also  be 
cone  (i  e  hyperacuitv)  has  been  so  intriguing  generalized  to  include  localization  of  more 
that  we  cannot  resist  trying  to  understand  it  widely  separated  objects 

However,  the  small-scale  stimuli  that  are  re-  Recently,  several  investigators  have  consid- 
quired  to  evoke  hyperacuity  responses  are  not  ered  an  alternative  to  the  local  sign,  or  position, 
only  uncommon  in  our  ordinary  experience,  approach,  they  have  been  exploring  the  possi- 
they  may  not  even  be  ideal  probes  of  the  bility  of  accounting  for  hyperacuity  directly  in 
localization  process  In  the  research  reported  terms  of  the  frequency  selectivity  of  the  units 
here,  large-scale  stimuli  are  used  to  explore  that  are  tuned  to  limited  ranges  of  spatial 
further  the  spatial  properties  of  the  localization  frequency  and  orientation  (Wtlson  and  Gelb. 
process  and  to  provide  new  tests  of  existing  1984;  Carlson  and  Klopfenstein,  1985.  Klein 
theories  of  localization  and  Levi,  1985)  [For  brevity  the  theoretical 
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stage  of  visual  processing  that  consists  of  such 
units  will  be  referred  to  as  the  primary  repre¬ 
sentation,  and  the  models  that  are  based  on  this 
representation  will  be  referred  to  collectively  as 
channel  models  ]  Although  details  of  various 
channel  models  differ,  they  share  the  common 
basic  assumption  that  the  distance  between  ob¬ 
jects  is  encoded  by  those  units  that  have  recep¬ 
tive  fields  that  are  large  enough  to  be  stimulated 
by  both  objects  simultaneously  It  is  this  basic 
concept  that  is  tested  in  the  experiments  re¬ 
ported  below. 

The  requirement  of  channel  models  that  the 
responsible  units  be  stimulated  simultaneously 
by  both  objects  being  localized  has  traditionally 
restricted  applicability  of  these  models  to  small 
object  separations,  and  Wilson  has  found  that 
this  model  does  not  apply  for  separations  larger 
than  about  one  degree  (Wilson  and  Gelb,  1984). 
However,  this  restriction  is  not  essential.  Local¬ 
ization  of  more  widely  separated  objects  could 
also  be  accounted  for  if  the  primary  represent¬ 
ation  contains  units  that  are  tuned  for  low 
spatial  frequencies  and  have  la'rge  receptive 
fields.  This  premise  may  not  be  unreasonable: 
Stromeyer  et  at.  (1982)  provided  evidence  for 
channels  with  peak  spatial  frequencies  consid¬ 
erably  less  than  0.5  c/d.  Therefore,  a  frequency 
channel  model  of  spatial  localization  could 
plausibly  be  expanded  to  include  objects  that 
are  separated  by  2  or  3  deg,  or  even  more,  by 
including  channels  that  are  tuned  to  lower  spa¬ 
tial  frequencies.  In  principle,  this  type  of  model 
could  account  for  the  relative  spatial  local¬ 
ization  of  any  two  objects  that  are  visible  simul¬ 
taneously. 

The  position  model  that  will  be  considered 
here  is  a  modification  of  that  invoked  by  pre¬ 
vious  local  signs  models.  This  modification  is 
prompted  by  the  considerable  quantitative  mod¬ 
eling  of  small-scale  localization  that  has  recently 
been  done  (e  g  Carlson  and  Klopfenstein,  1985; 
Klein  and  Levi,  1985;  Wilson,  1986).  The  model 
to  be  considered  here  assumes  that  the  primary 
representation  constitutes  the  initial  stage  of 
processing  for  the  localization  mechanism. 
However,  this  model  assumes  that  each  unit 
carries  information  not  only  about  its  spatial 
frequency  and  orientation  selectivity,  but  about 
ns  receptive  field  position  as  well.  It  further 
assumes  that  the  distance  between  objects  is  not 
encoded  explicitly  in  the  primary  represent¬ 
ation.  but  rather  is  inferred,  at  a  subsequent 
stage  of  visual  processing,  from  the  retinal 
position  information  The  model  also  assumes 


that  the  accuracy  with  which  the  distances  can 
be  inferred  is  determined  solely  by  the  accuracy 
of  the  position  information  obtained  from  the 
primary  representation.  Because  the  high- 
spatial-frequency  units  have  the  smallest  recep¬ 
tive  fields,  they  carry  the  most  precise  position 
information.  The  assumption  of  no  additional 
noise  from  the  localization  mechanism  itself  is 
made  because  of  its  simplicity;  it  is  implausible 
physiologically.  Alternative  assumptions  are 
considered  in  the  Discussion. 

Predictions  of  models 

Quantitative  models  are  deliberately  avoided 
in  this  paper  because  the  aim  is  to  determine  the 
general  validity  of  the  basic  frequency-channel 
and  position  concepts  rather  than  the  specific 
validity  of  any  particular  embodiments.  How¬ 
ever,  some  additional  constraining  assumptions 
are  required  before  testable  predictions  can  be 
made.  I  make  the  following  assumptions  about 
the  primary  representation:  (1)  the  retinal  recep¬ 
tive  field  density  and  the  spatial  frequency  band- 
widths  of  the  channel  units  scale  with  the  peak 
spatial  frequencies  of  these  units  (Blakemore 
and  Campbell,  1969;  Sakitt  and  Barlow,  1982) 
so  that  there  is  a  constant  relationship  between 
the  sampling  rate  and  the  peak  spatial  fre¬ 
quency;  (2)  the  units  in  the  primary  represent¬ 
ation  have  bandwidths  of  approximately  one  to 
two  octaves,  so  that,  for  example,  a  unit  that  is 
most  sensitive  to  high  spatial  frequencies  cannot 
simultaneously  detect  two  stimuli  that  are  sepa¬ 
rated  by  several  degrees  (Ejima  and  Takahashi. 
1984).  Alternative  possible  assumptions  are  con¬ 
sidered  in  the  Discussion  (Section  7). 

Weber  fraction  for  localization.  The 
frequency-channel  hypothesis  implies  that  the 
localization  threshold.  As,  will  scale  with  the 
separation,  s,  between  the  objects,  yielding  a 
constant  “Weber  fraction  for  localization," 
As/s.  Conversely,  the  position  hypothesis  im¬ 
plies  that,  for  separations  above  some  minimal 
value,  As  will  be  constant  (i.e.  As/s  will  decrease 
linearly  with  increasing  s)  because  the  accuracy 
of  the  positional  information  for  one  object  is 
unaffected  by  the  presence  of  another,  non- 
adjacent,  object. 

Adding  high  spatial  frequency  components. 
The  channel  hypothesis  implies  that,  for  a  pair 
of  widely  separated,  spectrally  complex  objects, 
enhancing  the  high  spatial  frequency  com¬ 
ponents  in  the  objects  will  not  affect  localization 
accuracy  According  to  this  hypothesis,  widely 
separated  objects  are  localized  by  mechanisms 


B-4 


Large  scale  localization 


419 


that  are  selectively  sensitive  to  low  spatial  fre¬ 
quencies.  and  hence  insensitive  to  high  spatial 
frequencies.  On  the  other  hand,  the  position 
hypothesis  implies  that  localization  accuracy 
will  be  improved  by  the  enhancement  of  high 
spatial  frequencies  in  the  objects  to  be  localized, 
because  units  that  are  tuned  to  high  spatial 
frequencies  yield  more  precise  positional  infor¬ 
mation  (due  to  their  spatially  more  localized 
receptive  fields),  and  it  is  assumed  that  the 
precision  of  the  information  in  the  primary 
representation  completely  determines  the  degree 
of  accuracy  obtainable. 

Subtracting  low  spatial  frequency  components. 
The  channel  hypothesis  includes  no  provision 
for  localizing  widely  separated  objects  that  have 
no  detectable  energy  at  low  spatial  frequencies 
(i.e.  narrow  band  high  frequency  objects). 
Therefore,  if  this  hypothesis  is  correct  then  there 
must  be  another  mechanism  for  localizing  such 
stimuli  On  the  contrary,  the  position  hypothesis 
does  not  require  another  mechanism  to  deal 
with  these  stimuli  It  implies  that  widely  sepa¬ 
rated.  narrowband,  high  spatial  frequency  ob¬ 
jects  will  be  localized  (by  the  mechanism  that  is 
responsible  for  localization  of  less  esoteric  stim¬ 
uli)  as  accurately  as  spectrally  complex  stimuli 
(and  more  accurately  than  low  frequency  ob¬ 
jects). 

Although  either  the  position  or  frequency- 
channel  hypothesis  could  conceivably  be  fit  into 
a  theoretical  framework  that  accounts  for  al¬ 
most  any  result,  that  could  not  be  done  without 
seriously  contradicting  the  essences  of  the  basic 
hypotheses.  The  predictions  made  above  are 
those  that  seem  to  follow  most  naturally  from 
the  basic  position  and  frequency-channel  con¬ 
cepts. 

2.  THE  WEBER  FRACTION  FOR 
LOCALIZATION 

Precious  findings 

Volkmann  performed  the  classic  study  of 
localization  thresholds  for  a  wide  range  of  ob¬ 
ject  separations  in  1863  (von  Helmholtz,  1910). 
In  Volkmann's  experiments,  observers  centered  a 
middle  line  between  two  flanking  lines.  The 
flanking  lines  were  separated  by  distances  rang¬ 
ing  from  0.7  to  16  7  deg  He  found  A S'S  to  be 
approximately  constant  over  that  range,  con¬ 
tradicting  the  prediction  of  the  position  hypoth¬ 
esis  as  sketched  above  I  repeated  his  experi¬ 
ments  under  somewhat  different  conditions,  and 
obtained  similar  results 


Fig.  I.  Representation  of  the  two-bar  stimulus  The  size  of 
the  bars  was  scaled  with  the  separation  between  them, 
according  to  the  ratio  shown  here 


Methods 

Two  paradigms  were  used:  the  three-bar  bi¬ 
section  task  of  Volkmann,  and  a  two-bar  task  in 
which  the  interbar  distance  is  compared  to  a 
learned  reference  distance.  In  both  the  two-bar 
and  three-bar  experiments,  the  objects  to  be 
localized  were  horizontal  rectangular  bars,  as 
sketched  in  Fig.  1  for  the  two-bar  case.  They 
were  displayed  on  a  video  monitor  (Conrac, 
Model  2400,  19  in.  diagonal,  60-Hz  non¬ 
interlaced  frame  rate,  512  x  512  pixels)  that  also 
provided  a  constant  background  luminance  of 
90cd/m2.  The  luminance  of  the  bars  was 
171cd/m2,  which  resulted  in  45%  contrast. 
(Contrast  in  these  experiments  is  defined  to  be 
(Lro„  -  LmJ/2Lbkgtd.  where  Lbkgrd  is  the  lumi¬ 
nance  of  the  background,  which  was  constant. 
(For  these  rectangular  bar  stimuli  Lmm  =  Z,bkgrd, 
but  in  subsequent  experiments,  a  more  general 
definition  is  required.)  The  visual  angles  sub¬ 
tended  by  the  two  dimensions  of  each  bar  were 
always  proportional  to  the  distance  between  the 
bars,  as  if  the  viewing  distance  alone  were 
changed,  The  relationship  between  bar  size  and 
mean  separation  is  that  shown  in  Fig.  1. 

Actually,  both  the  viewing  distance  and  the 
stimulus  itself  were  changed  to  achieve  the  wide 
range  of  object  separations  used  At  the  smallest 
separations,  a  camera  lens  was  used  to  reimage 
the  stimulus  at  a  smaller  scale  When  the  lens 
was  used,  the  stimulus  was  imaged  in  an  aper¬ 
ture  that  was  surrounded  by  a  large  uniform 
field  that  was  illuminated  to  match  the  screen 
approximately  in  brightness  and  hue.  The  effects 
on  localization  accuracy  of  viewing  distance  and 
optical  mmification  were  checked  by  using 
different  combinations  of  viewing  distance. 
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stimulus  size,  and  optical  minification  to  achieve 
a  single  object  separation  and  bar  size.  No 
significant  effects  of  viewing  distance,  per  se,  or 
of  optical  minification  were  observed.  To  pre¬ 
vent  the  observer  from  using  the  distance  to  the 
edge  of  the  screen  as  a  cue,  the  bars  were  kept 
well  away  from  the  edge,  and  the  position  of  the 
pair  of  bars  relative  to  the  upper  and  lower 
edges  was  varied  randomly  from  trial  to  trial. 
Viewing  was  monocular. 

The  method  of  constant  stimuli  was  used  to 
measure  localization  accuracy  at  each  of  10 
object  separations,  approximately  equally 
spaced  on  a  log  scaic,  covering  the  range 
3.4-764  min  of  arc  in  the  two-bar  condition,  and 
3.6-405  min  of  arc  in  the  three-bar  condition.  In 
a  given  experimental  session,  measurements 
were  made  at  a  single  object  separation,  with  a 
single  type  of  stimulus  and  task,  i.e.  either  two- 
or  three-bar. 

Each  stimulus  was  presented  with  an  abrupt 
onset  and  was  left  on  at  full  (i.e.  45%)  contrast 
until  the  observer  responded.  Right/wrong  feed¬ 
back  was  given  after  each  trial. 

Two-bar  condition.  For  each  object  sepa¬ 
ration,  s,  the  test  separations  were  s  +  n(ds),  for 
n  =  ±  1  to  ±5.  The  increment,  ds,  was  deter¬ 
mined  in  preliminary  experiments  for  each  ob¬ 
server  and  for  each  value  of  s,  so  that  the 
observer  was  correct  about  90%  of  the  time 
when  1 « |  equaled  5.  Each  of  the  ten  stimuli  was 
presented  5  times  in  a  given  session,  and  at  least 
5  sessions  were  conducted  at  each  object  sepa¬ 
ration,  yielding  at  least  250  trials  for  each 
psychometric  function.  Data  were  collapsed 
across  the  sign  of  n,  so  that  a  single  percent 
correct  value  represented  a  given  offset  value 
(without  regard  to  whether  the  test  separation 
was  that  much  larger  or  that  much  smaller  than 
the  reference  separation) 

On  each  trial,  a  single  pair  of  bars  was 
presented  The  observer's  task  was  to  determine 
whether  the  distance  between  the  bars  was  more 
or  less  than  the  average  object  separation  seen 
during  the  previous  trials.  The  experienced  ob¬ 
servers  quickly  learned  the  standard  and  typi¬ 
cally  performed  at  a  stable  level  after  50-100 
trials.  At  least  two  practice  sessions  of  50  trials 
each  were  conducted  whenever  the  mean  object 
separation  was  changed,  and  at  least  one 
practice  session  (of  50  trials)  was  conducted  at 
the  beginning  of  each  data  collection  period. 
The  results  of  these  practice  sessions  were  not 
included  in  the  calculations  of  localization 
accuracy. 


Three-bar  condition.  In  this  paradigm,  there 
was  no  fixed  reference  distance.  The  observer 
compared  the  distance  between  the  top  bar  and 
middle  bar  to  the  distance  between  the  middle 
bar  and  bottom  bar.  If  the  mean  separation  was 
s,  then  the  bars  in  a  given  trial  were  separated 
by  s  +n(ds/2)  and  s  —  n(dsf 2),  with  the  larger 
separation  occurring  equally  often  on  the  top 
and  bottom.  The  observer’s  task  on  each  trial 
was  to  determine  which  separation  was  larger 
Data  were  averaged  over  the  "top  distance 
larger"  and  “bottom  distance  larger"  condi¬ 
tions.  The  three-bar  experiments  were  otherw  ise 
identical  to  the  two-bar  experiments 

Data  analysis 

Standard  probit  analysis  techniques  (Finnes. 
1971)  were  used  to  analyze  the  data.  The  per 
cent  correct  value  for  each  offset  was  corrected 
for  guessing  [(percent  correct  -  50)  x  2],  con¬ 
verted  to  probits,  and  then  plotted  as  a  function 
of  the  offset  value.  The  resulting  function  was 
approximated  by  a  straight  line,  using  linear 
regression,  and  the  offset  corresponding  to  the 
50%  correct  point  was  determined  from  the 
linear  approximation.  This  value.  As.  is  a  mea¬ 
sure  of  the  localization  threshold.  To  relate  this 
value  to  the  scale  of  the  stimulus,  A s  was  divided 
by  the  mean  separation,  s,  yielding  the  “Weber 
fraction  for  localization,"  A  s/s. 

Results 

Localization  accuracy  for  both  stimulus  con¬ 
ditions  is  plotted  as  a  function  of  mean  sepa¬ 
ration  in  Fig.  2.  Data  were  obtained  from  two 
observers  for  the  three-bar  condition,  and  from 
one  observer  for  the  two-bar  condition  The 
average  standard  error  was  approximately  twice 
the  width  of  a  data  point  It  is  clear  that,  when 
localization  accuracy  is  expressed  as  a  per 
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Fig  2  Localization  aceurac>.  plotted  as  a  function  of  me.ir 
separation  betsseen  the  objects  being  localized  is  esscnn.i'.i 
constant  once  a  minimum  separation  is  exceeded. 
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centage  of  the  mean  separation  between  the 
objects,  as  it  is  here,  it  does  not  vary  substan¬ 
tially  with  object  separation,  once  the  sepa¬ 
ration  exceeds  a  minimum  value  of  a  few 
minutes  of  arc. 

The  results  of  these  experiments  verify  Volk- 
mann’s  finding  that  the  threshold,  As,  is  pro¬ 
portional  to  the  mean  separation,  s,  over  a  large 
range  of  object  separations.  Thus,  the  Weber 
fraction  for  localization,  As/s,  is  essentially  con¬ 
stant.  Note  that  this  result  is  not  specific  to 
either  stimulus  configuration  (or  task).  The  two- 
bar  and  three-bar  paradigms  yield  the  same 
estimates  of  localization  accuracy,  over  the  large 
range  of  object  separations  tested.  Therefore, 
either  paradigm  can  be  used  without  loss  of 
generality. 

3.  SPATIAL  FREQUENCY 
EFFECTS— ENHANCING  THE 
HIGH-SPATIAL-FREQUENCY 
COMPONENTS 

The  following  experiments  investigate  the  role 
of  high  spatial  frequencies  in  the  localization  of 
spectrally  complex  stimuli  that  are  separated  by 
several  degrees  of  visual  angle.  The  channel 
concept  implies  that  high  frequencies  play  ho 
part  in  this  task;  the  position  concept  relies  on 
them  for  highest  precision. 

It  is  impossible  to  understand  the  role  of 
high-spatial-frequency  components  in  local¬ 
ization  without  investigating  the  effects  of  con¬ 
trast  simultaneously,  because  high  spatial  fre¬ 
quencies  could  appear  to  provide  poor  support 
for  localization  judgments  simply  because  of 
their  lower  effective  contrasts.  To  separate  fre¬ 
quency  effects  from  contrast  effects,  I  measured 
localization  accuracy  over  a  range  of  contrasts 
and  examined  the  functions  relating  localization 
accuracy  to  contrast.  I  used  “bars”  with 
different  luminance  profiles,  as  shown  in  Fig 
3(a)  and  (b). 

Methods 

In  the  absence  of  prior  knowledge,  it  seemed 
reasonable  to  adopt  the  common  practice  of 
using  the  contrast  detection  threshold  for  each 
stimulus  as  a  normalization  constant.  This  was 
done,  and  localization  accuracy  was  measured 
at  several  fixed  multiples  of  the  contrast 
detection  threshold  The  use  of  several  stimulus 
contrasts  provided  a  check  on  the  appropri¬ 
ateness  of  the  normalization  procedure,  and 
also  revealed  the  effects  of  contrast,  per  se, 
which  will  be  considered  later 


Fig  3  Sketches  of  the  vertical  luminance  profiles  of  the 
stimuli  used  in  the  experiments  reported  in  Sections  3  e. 

All  stimuli  were  presented  for  225  msec  with 
abrupt  onsets  and  terminations.  The  mean  ob¬ 
ject  separation  was  fixed  at  175  min  of  arc. 
consistent  with  the  goal  of  investigating  large- 
scale  localization.  At  the  142  cm  viewing  dis¬ 
tance  that  was  used,  one  line  of  the  raster 
display  subtended  1 .20  min  of  arc,  so  the  highest 
displayable  frequency  was  25cy/deg  The  stim¬ 
uli  were  stabilized  on  the  observer’s  retina  by 
means  of  an  SRI  Dual-Purkinje-Image  eye- 
tracker  (Crane  and  Steele.  1978)  and  stimulus 
deflection  system  (Crane  and  Clark.  1978)  to 
ensure  that  the  observer  maintained  central 
fixation.  This  was  important  because  of  the 
well-known  variation  in  contrast  sensitivity  with 
retinal  eccentricity 

Conlrast  detection  thresholds  were  measured 
by  a  yes  no  staircase  procedure  Localization 
accuracy  was  measured  by  the  method  of  con¬ 
stant  stimuli,  as  in  the  previous  experiments 
The  two-bar  paradigm  was  used 

The  rectangular  bar  stimulus  used  in  the 
previous  experiments  serves  as  the  reference 
stimulus  for  the  experiments  that  follow  This 
stimulus  is  spectrally  complex,  with  most  of  1 1 s 
energy  at  low  spatial  frequencies  The  Fourier 
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<d)  BLACK  AND  WHITE  BARS 

Fig  4  Fourier  transforms  of  (he  stimuli  used  in  ihe  experiments  reporied  in  Sections  i  '■ 


spectrum  of  the  rectangular  bar  stimulus  (before 
it  was  convolved  with  the  line  spread  function 
of  the  drsplav )  is  shown  in  F  ig  4(a)  Separation 
between  the  bars  was  set  at  the  mean  value  of 
P5min  of  arc  lor  this  calculation 
To  determine  the  role  of  the  high-spatial 
frequenev  components  in  this  tvpe  of  large-scale 


localisation  task.  1  changed  to  a  stimulus  m 
which  most  of  the  energv  is  in  the  high  ichc 
than  the  low.  frequenev  region  This  stimuli!- 
sketched  in  F  ig  ‘1(b).  consisted  ol  a  strip-  ,  ■ 
horizontal  grating  of  c  deg  I  he  verti.il  and. 
horizontal  extent  o!  the  grating  strips  matched, 
that  of  the  rectangular  bars  (as  shown  m  Fig;  l  ■ 
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Large  scale 

The  one-dimensional  Fourier  spectrum  of  this 
stimulus  (before  it  was  convolved  with  the 
line  spread  function  of  the  display)  is  shown  in 
Fig.  4(b). 

It  is  important  to  note  that  this  sped,  -m  does 
not  accurately  reflect  the  impact  of  this  stimulus 
on  the  visual  system  The  variation  in  contrast 
sensitivity  with  spatial  frequency  must  also  be 
factored  in.  Threshold  for  a  I  c/degree  grating  is 
approximately  I /100th  that  for  a  25  c/deg  gra¬ 
ting,  even  at  the  fovea  (Koenderink  and  van 
Doom,  1978),  whereas  in  the  Fourier  spectrum 
of  this  high-frequency-bar  stimulus,  the  (small) 
peak  at  1  c/deg  has  I /25th  the  amplitude  of  that 
at  25  c/deg.  Thus,  from  a  frequency-channels 
perspective,  it  is  not  surprising  that,  at  thresh¬ 
old,  this  stimulus  does  not  appear  to  be  a 
high-frequency  stimulus,  that  is,  the  gratings  are 
not  resolved  and  the  bars  appear  uniform  in 
luminance.  This  appearance  suggests  that  a 
more-sensitive,  low-frequency  mechanism  is 
active  at  the  contrast  threshold.  However, 
as  the  stimulus  contrast  is  increased,  the 
differences  between  the  high-frequency  and  the 
rectangular-bar  stimuli  become  significant. 
Even  a  qualitative  comparison  of  the  Fourier 
transforms  of  these  two  stimuli  suggests  that 
high-spatial-frequency  components  should  be¬ 
come  suprathreshold  at  much  lower  stimulus 
contrasts  for  the  high-frequency  bars  than  they 
do  for  the  rectangular  bars.  Thus,  if  localization 
accuracy  is  enhanced  by  high  spatial  fre¬ 
quencies,  as  the  position  hypothesis  implies, 
then,  at  high  stimulus  contrasts,  localization 
accuracy  for  the  high-frequenrv  bars  should 
exceed  that  for  the  rectangular  bars 

Results 

Graphs  of  localization  accuracy  as  a  function 
of  stimulus  contrast  (expressed  as  multiples  of 
the  detection  threshold)  for  both  conditions  are 
shown  in  Fig  5.  The  curves  have  essentially  the 
same  shape,  which  suggests  that  the  use  of  the 
contrast  threshold  as  a  normalizing  constant 
was  appropriate  Furthermore,  the  thresholds 
for  the  two  conditions  arc  essentially  the  same 
at  all  contrasts  The  largest  difference  in  the 
localization  thresholds  for  these  two  conditions 
is  at  5  times  the  detection  thresholds  The 
psychometric  functions  underlying  those  data 
points  are  shown  in  Fig  6 

The  data  of  Figs  5  and  6  give  no  hint  of  the 
large  difference  in  the  relative  amplitudes  of  the 
high-  and  low-frequency  regions  for  the  two 
stimuli  that  is  evident  in  their  Fourier  trans 
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Fig  5  Localization  accuracy,  tssis,  as  a  function  of  the 
contras!  of  the  bars.  Contrast  is  expressed  as  multiples  of 
the  contrast  detection  threshold  for  each  stimulus 
Observer  SG 

forms  (Fig.  4(a)  and  (b)]  This  result  contradicts 
the  prediction  of  the  position  hypothesis  that 
enhancing  the  high-spatial-frequency  com¬ 
ponents  will  improve  localization  accuracy  (h\ 
improving  the  precision  of  the  position  informa¬ 
tion  available  from  the  primary  representation) 

4.  SPATIAL  FREQUENCE 
EFFECTS— SUBTRACTING  THE 
LOW-SPATIAL  FREQUF.NO 
COMPONENTS 

The  results  of  the  two  previous  experiments 
were  consistent  with  the  hypothesis  that  local¬ 
ization  of  widely  separated  objects  is  done  on 
the  basis  of  low-spatial-frequency  information 
To  test  this  hypothesis  directly,  I  measuied 
localization  accuracy  as  a  function  of  contrast 
using  a  narrower-handwidth.  high  spatial- 
frequency  stimulus  that  has  no  detectable  en¬ 
ergy  at  low  spatial  frequencies  The  vertical 
luminance  profile  of  this  stimulus  is  sketched  in 
Fig  J(c)  and  its  Fourier  transform  is  shown  in 
Fig  4(c)  This  stimulus  consists  ol  a  pair  <U 
'‘bars,"  each  ol  which  is  a  horizontal  sinewave 
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Fig  7  Localization  accuracy,  ii  ),  as  a  function  of  the 
contrast  of  the  bars  (expressed  as  multiples  of  the  detection 
threshold)  for  solid  rectangular  bars  and  for  strips  of 
25  c/degree  horizontal  grating  with  Gaussian  contrast  en¬ 
velopes  [see  Figs  4(C)  and  4(c)]  Localization  accuracy  for 
the  Gaussian-modulated  high  frequency  bars  was  measured 
at  2.3  and  3  6  times  the  contrast  threshold 

grating  of  25  c/degree  whose  contrast  is  modu¬ 
lated  by  a  Gaussian  function  with  a  =9.6  min 
of  arc. 

The  contrast  detection  threshold  for  this  stim¬ 
ulus  was  more  than  25° o  (measured  at  the 
retinal  eccentricity  at  which  it  was  presented  in 
the  localization  experiments),  so  localization 
accuracy  could  not  be  measured  at  more  than 
3-4  times  threshold  Furthermore,  this  narrow- 
band  stimulus  quickly  caused  significant  pattern 
adaptation  effects,  even  though  the  stimulus 
presentations  were  brief  (225  msec)  Thus,  local¬ 
ization  accuracy  also  could  not  readily  be  mea¬ 
sured  when  the  contrast  was  near  the  detection 
threshold  Data  for  the  two  conditions  that 
could  be  measured  are  shown  in  Fig  7.  (Data 
from  the  original  rectangular  bar  condition  are 
also  shown  for  comparison.) 

As  with  the  other  stimuli,  localization  accu¬ 
racy  improves  with  increasing  contrast,  and,  as 
far  as  can  be  ascertained  from  these  limited 
data,  it  increases  at  the  same  rate.  However, 
there  is  a  small  overall  reduction  in  accuracy  for 
this  condition  relative  to  the  others.  Detailed 
exploration  of  the  cause  of  this  difference  is 
beyond  the  scope  of  the  present  paper  How¬ 
ever,  in  experiments  reported  elsewhere  (Bur- 
beck.  1986).  I  explored  the  effects  of  exposure 
duration  on  localization  accuracy  and  found 
that,  when  the  stimulus  is  left  on  until  the 
observer  responds  (as  in  the  first  experiments 
reported  above),  localization  accuracy  is  essen¬ 
tially  as  high  for  these  Gaussian-modulated. 
high-frequency  bars  as  it  is  for  the  rectangular 
bars  Thus,  it  appears  that  activation  of  low- 
spatial-frequency  mechanisms  is  not  required 
for  optimal  localization  of  widely  separated 
objects  The  data  also  do  not  suggest  the  exis¬ 
tence  of  a  second  localization  mechanism 


5.  SPATIAL  FREQUENCE 
EFFECTS — CHANGING  THE 
LOW -SPATIAL- FREQ  l  ENC  5 
COMPONENTS 

Since  I  have  established  (Section  2)  that  the 
Weber  fraction  for  localization  is  constant  with 
separation  over  a  wide  range,  another  inference 
can  be  drawn  from  the  frequency-channel  hy¬ 
pothesis  of  localization  In  this  hypothesis, 
widely  separated  objects  are  localized  by  chan¬ 
nels  tuned  to  low  spatial  frequencies,  and  the 
accuracy  with  which  a  given  frequency  can  be 
represented  scales  with  the  frequency  There¬ 
fore,  if  the  dominant  low  spatial  frequency  of 
the  stimulus,  /,  is  halved — for  example,  by 
doubling  the  mean  separation — then  the  accu¬ 
racy  with  which  the  frequency  is  represented. 
A/,  should  also  be  halved  In  this  theory,  the 
internal  constant  A///  is  responsible  for  the 
observed  constant  At  s.  However,  the  dominant 
low  spatial  frequency,  /,  may  be  changed  by 
other  means  as  well  In  particular,  if  the  contrast 
polarity  of  one  bar  is  reversed  [Fig  7(d)],  then 
/ is  halved  [arrows  in  Fig  4(a)  and  ( d )],  but  s  is 
unchanged.  If  the  frequency-channel  hypothesis 
is  correct,  this  change  to  the  stimulus  should 
double  As/j.  If  the  position  model  is  correct 
there  will  be  no  change  in  localization  accuracy 

To  test  these  predictions,  I  measured  local¬ 
ization  accuracy  as  a  function  of  contrast  for 
one  black  bar  and  one  white  bar.  The  results  of 
this  experiment  are  shown  in  Fig  8,  together 
with  the  previous  rectangular-bar  data  from 
Fig.  5. 

The  effect  on  localization  accuracy  of  this 
stimulus  manipulation  docs  not  come  close  to 
the  factor-of-two  change  in  localization  thresh¬ 
old  predicted  by  the  frequency-channel  hypoth¬ 
esis  This  result  is  consistent  with  the  position 
hypothesis,  however 
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Fig  8  Localization  accuracy  Aj  <  as  a  lunctior  of  the 
contrast  of  the  bars  (expressed  in  multiples  o'  (he  octec'i-'i 
thresholds) 
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6.  CONTRAST  effects 

Although  neither  of  the  hypotheses  consid¬ 
ered  here  leads  to  specific  predictions  about  how 
contrast  should  affect  localization  accuracy,  it  is 
interesting  to  consider  what  contrast  effects  can 
tell  us  about  the  localization  process  Contrast 
effects  have  been  reported  previously  in  the 
context  of  hyperacuity  studies,  and  some  expla¬ 
nations  have  been  suggested  for  them  in  that 
context  The  two  that  I  will  consider  here  are 
that  as  contrast  is  increased,  (I  I  the  high- 
frequency  mechanisms,  which  provide  the  best 
positional  information  but  which  have  lower 
contrast  sensitivity,  become  activated — the 
change-of-channel  hypothesis  (Wilson  and 
Gelb,  1984,  Carlson  and  Klopfenstem,  1985), 
and  (2)  the  signal-to-noise  ratio  improves  in  a 
way  predictable  from  contrast  increment 
thresholds-  the  signal-to-noise  hypothesis 
(Klein  and  Levi,  1985) 

The  change-of-channel  hypothesis  is  not  sup¬ 
ported  by  my  data  on  the  effects  of  enhancing 
the  high-spatial-frequency  content  of  the  bars:  if 
localization  accuracy  for  the  rectangular  bars 
improves  with  increasing  contrast  because  the 
high-frequency  components  of  the  stimulus  be¬ 
come  suprathrcsiiold  as  contrast  is  increased, 
then  this  improvement  ought  to  be  even  more 
ev  ident  for  the  high-frequency  bars  In  particu¬ 
lar,  the  slope  of  the  contrast  vs  localization- 
accuracy  curve  should  be  steeper  for  the  high- 
trequcncy  bars  than  for  the  rectangular  bars.  It 
is  not  Therefore,  this  result  argues  against  the 
change-of-channel  hypothesis. 

On  the  other  hand,  the  signal-to-noise  hy¬ 
pothesis  can  account  for  the  contrast  effects 
reported  above,  and  it  is  compatible  with  both 
the  frequency-channel  and  the  position  hypoth¬ 
eses.  In  fact,  the  magnitude  of  the  contrast  effect 
obtained  here  is  in  reasonable  agreement  with 
predictions  made  by  Kirin  and  Levi  (1985)  for 
hyperacujty  stimuli,  using  contrast  increment 
detection  data  However,  there  is  a  suggestion  in 
the  data  (Fig.  5)  of  a  decline  in  localization 
accuracy  between  5  and  10  times  the  contrast 
threshold,  which  would  not  be  consistent  with  a 
signal-to-noise  hypothesis.  For  a  more  detailed 
picture  of  the  effects  of  contrast  on  localization, 
the  psychometric  functions  from  which  the  data 
of  Fig  5  were  generated  are  shown  in  Fig  9, 
The  improvement  in  localization  accuracy  be¬ 
tween  2  and  5  times  threshold  [Fig  9(a)]  is  clear 
and  systematic  However,  the  slight  decline  in 
accuracy  as  contrast  is  increased  further  (Fig 


9(b)]  is  insufficient  to  reject  the  signal-to-noise 
hypothesis  Thus,  the  signal-to-noise  hypothesis 
could  reasonably  account  for  these  data 

7.  DISCI  SSION 

Neither  the  frequency-channel  hypothesis  nor 
the  position  hypothesis,  as  outlined  above,  can 
account  for  all  of  the  results  reported  here  T  he 
frequency-channel  hypothesis  is  consistent  with 
the  constant  Weber  fraction  for  localization, 
and  it  accounts  for  the  insensitivity  of  the 
localization  mechanism  to  the  presence  of  high 
spatial  frequencies  (in  spectrally  complex  stim¬ 
uli)  However,  the  channel  hypothesis  is  con¬ 
tradicted  by  the  high  localization  accuracy  ob¬ 
tainable  with  widely  separated,  narrow-band 
high-spatial-frequency  bars,  and  by  the  insen¬ 
sitivity  of  the  localization  threshold  to  the  rela¬ 
tive  polarities  of  the  widely-separated  bars  The 
position  hypothesis,  on  the  other  hand,  is  con¬ 
tradicted  by  both  sets  of  "high-frequency-bar" 
data,  because  it  predicts  that  localization  should 
be  even  more  accurate  for  high-frequency  stim¬ 
uli  than  for  stimuli  that  have  less  energy  at  high 
spatial  frequencies.  The  position  hypothesis  is 
also  contradicted  by  the  constant  Weber  frac¬ 
tion  for  localization  Therefore,  the  problem 
clearly  is  not  whether  the  position  hypothesis  or 
the  frequency-channel  hypothesis  accounts  for 
the  data,  but  whether  either  hypothesis  can  be 
modified  to  account  for  the  observed  results 

The  frequency-channel  hypothesis  is  consis¬ 
tent  with  more  of  the  observed  results  than  is  the 
position  hypothesis,  but  modifying  or  adding  to 
it  seems  less  promising.  There  is  no  apparent 
way  to  deal  with  the  lack  of  effect  of  bar 
polarity.  Localization  of  the  narrow-band  high- 
frequency  bars  is  also  fundamentally  inconsis¬ 
tent  with  his  hypothesis.  To  account  for  the 
narrow-band,  high-frequency  data,  one  would 
have  to  postulate  either  that  high-spatial- 
frequency  units  have  very  large  spatial  extents 
or  that  there  aie  two  equally  sensitive  mech¬ 
anisms,  one  for  localizing  stimuli  with  de¬ 
tectable  energy  at  low  spatial  frequencies  and 
one  for  localizing  all  other  stimuli  Neither  of 
these  alternatives  is  very  attractive 

Modification  of  the  position  hypothesis  seems 
more  promising  simply  because  it  is  less  con¬ 
strained  The  subsequent  stage  of  processing  m 
w'hich  the  distance  between  objects  is  inferred 
from  the  retinal  position  information  can  easilv 
be  modified  to  account  lor  the  findings  reported 
above  For  example,  a  plausible  mechanism  that 
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yields  consiant  A.v  s  can  be  obiained  simply  by 
postulating  that  the  same  type  of  operations 
that  created  the  primary  representation  act 
analogously  on  that  representation  to  yield  a 
secondary  representation  This  postulated  sec¬ 
ondary  representation  would  encode  the  pattern 
of  excitation  in  the  (retinotopic)  primary  repre¬ 
sentation  and  hence  contain  information  about 
the  distance  between  those  areas  of  excitation.  If 
the  sampling  principles  that  have  been  theorized 
for  the  primary  representation  (Sakitt  and  Bar- 
low,  1 982 )  also  apply  to  the  secondary  repre¬ 
sentation.  then  large  separations  will  be  encoded 
with  proportionately  less  accuracy  than  small 
separations,  yielding  a  constant  Weber  fraction 
for  localization  (A  similar  scheme  has  been 
suggested  by  Hirsch  and  Hylton  (1982)  in  a 
somewhat  different  theoretical  context  ]  This 
model  can  also  account  for  the  localization 
mechanism's  insensitivity  to  the  frequency  con¬ 
tent  of  the  stimulus  when  localization  accuracy 
is  limited  by  the  resolution  of  the  secondary 
representation  (i.e.  when  the  objects  to  be  local¬ 
ized  are  well-defined  discrete  objects,  as  they 
were  in  all  of  the  experiments  reported  here). 
Highly  diffuse,  or  near-threshold-contrast  stim¬ 
uli  would  be  expected  to  yield  quite  different 
results. 

Objects  that  are  separated  by  only  a  few 
minutes  of  arc  would  also  be  expected  often  to 
yield  different  results,  according  to  this  modified 
position-model.  With  such  small-scale  stimuli, 
the  local  spatial-frequency  response  changes 
with  the  separation  between  the  targets,  even 
though  localization,  per  sc ,  is  not  done  at  the 
primary  representation  (i.e  frequency  channels 
stage)  Thus,  with  such  stimuli,  localization 
accuracy  may  be  determined  by  the  properties 
of  units  in  the  primary  representation  rather 
than  by  the  properties  of  the  (secondary)  local¬ 
ization  mechanism  itself  Stimulus  parameters 
such  as  contrast,  line  length,  and  gap  width, 
which  have  a  large  effect  in  the  primary  repre¬ 
sentation,  could  reasonably  be  accounted  for  by 
channel  models  However,  Morgan  and  Ward 
(1985)  have  elegantly  shown  that,  even  with 
small-scale  stimuli,  careful  experimental  design 
can  break  the  connection  between  local  channel 
responses  and  localization  accuracy.  When  this 
is  done,  channel  models  are  inadequate  to  ac¬ 
count  for  the  observer's  performance. 

The  approach  taken  here  has  been  to  separate 
the  properties  of  the  localization  mechanism 
from  those  of  the  primary  representation  by 
separating  the  targets  by  several  degrees  With 
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Fig  9.  Psychometric  functions  for  the  rectangular  bar 
stimuli  from  which  the  thresholds  shown  in  Fig  5  were 
calculated,  (a)  Between  2  and  5  times  threshold,  the  im¬ 
provement  in  localization  accuracy  with  increasing  conirasi 
is  clearly  systematic  and  statistically  significant  (b)  Psycho¬ 
metric  functions  for  the  rectangular  bar  stimuli  at  5  and  HI 
times  the  contrast  threshold 

such  widely  separated  targets  the  local  spatial 
frequency  response  is  unaffected  by  changes  in 
target  separation.  Therefore,  the  spatial  proper¬ 
ties  that  are  observed  are  those  of  the  local¬ 
ization  mechanism  itself.  It  is,  of  course,  possi¬ 
ble  "hat  there  are  two  mechanisms  for 
localization,  one  for  small-scale  and  one  for 
large-scale  stimuli.  However,  there  is  some  evi¬ 
dence  against  this  (Smith,  1982,  Burbcck.  1986) 
and  without  specific  evidence  for  two  mech¬ 
anisms,  a  single  mechanism  is  the  more  parsi¬ 
monious  assumption.  According  to  the  model 
proposed  here,  there  is  a  single  localization 
mechanism,  and  differences  between  local¬ 
ization  of  large-  and  small-scale  stimuli  arc 
accounted  for  by  differences  in  the  response  of 
the  primary  representation. 

Alternatives  to  the  primary  representation 

All  of  the  models  that  were  considered  here 
rely  on  the  assumption  that,  at  an  early  stage  of 
spatial  processing,  units  exist  that  are  selective 
to  a  limited  range  of  spatial  frequencies  and 
orientations  This  hypothesis  could  be  false  An 
alternative,  which  has  been  considered  in  the 
context  of  hvperacuity  studies,  is  the  ze:- 
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Large  scale  localization 


crossing  mode!  cogently  described  by  Marr 
(1982).  In  this  model,  the  human  visual  system 
begins  its  spatial  analysis  by  determining  the 
locations  of  the  zero-crossings  of  the  second 
derivative  of  the  luminance  distribution. 
Morgan  el  al.  (1984)  have  proposed  that  these 
zero  crossings  are  used  in  small-scale  local¬ 
ization  judgments  Such  a  scheme  could  be  used 
as  the  initial  stage  in  the  position  model  just 
described.  However,  the  analog  relationship  be¬ 
tween  the  primary  and  secondary  represent¬ 
ations  would  be  lost.  The  position  model  as 
described  above  with  two  recursive  stages  is 
more  parsimonious  and  appears  to  be  able  to 
account  for  all  of  the  results  reported  above. 
Quantitative  development  of  such  a  model 
would  be  a  major  undertaking,  but  it  may 
provide  important  insights  into  the  mechanisms 
behind  some  basic  visual  abilities. 
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The  effects  on  localization  accuracy  of  increasing  exposure  duration  beyond  100  msec  are  explored  for  a  wide  range 
of  object  separations.  Previous  reports  that  localization  accuracy  for  objects  separated  by  a  few  minutes  of  arc 
increases  for  exposures  up  to  at  least  400  msec  are  confirmed.  I  report  here  that  localization  of  larger  objects  at 
larger  separations  does  not  improve  when  the  exposure  duration  is  increased  beyond  100  msec.  This  difference 
between  the  small  and  large-scale  results  can  be  explained  by  the  difference  in  the  spatial-frequency  content  of  the 
objects  being  localized:  When  high-frequency  objects  are  substituted  for  spectrally  broadband  objects  in  the  large 
scale  case,  the  exposure-duration  effects  for  widely  separated  objects  become  similar  to  those  obtained  in  the  small 
scale  case  These  results  suggest  that  the  exposure-duration  effect  previously  reported  in  hyperacuity  studies  is  not 
specific  to  the  localization  task  per  se  but  rather  is  a  suprathreshold  version  of  the  familiar  form  of  spatiotemporal 
interaction  seen  in  contrast-threshold  results.  They  also  suggest  that  a  single  type  of  mechanism  underlies  small 
and  large  scale  localization 


1.  INTRODUCTION 


Previous  studies  of  the  effects  of  exposure  duration  on  local¬ 
ization  accuracy1  4  have  focused  on  the  Idealization  of  ob¬ 
jects  that  are  separated  by  only  a  few  minutes  of  arc,  where 
hyperacuity  thresholds  are  obtained.  In  these  studies,  lo¬ 
calization  accuracy  was  found  to  improve  with  increasing 
exposure  duration  up  to  400  msec  or  more,  leading  the  vari¬ 
ous  investigators  to  conclude  that  the  localization  mecha¬ 
nism  has  a  much  longer  integration  time  than  does  the  mech 
anism  underlying  simple  detection,  where  a  critical  duration 
of  100  msec  is  more  typical/ ^  The  research  reported  here 
examines  the  effects  of  exposure  duration  on  localization 
over  a  wide  range  of  object  separations  and  investigates  the 
source  of  the  exposure-duration  effects  obtained. 


2.  EXPOSURE-DURATION  EFFECTS  AT  A 
RANGE  OF  OBJECT  SEPARATIONS 


A.  Methods 

The  objects  to  be  localized  were  horizontal  rectangular  bars, 
as  sketched  in  Fig  1  They  were  displayed  on  a  video  moni¬ 
tor  [C'onrac  Model  2400,  19-in.  (48.26-cm)  diagonal,  60-Hz 
noninterlaced  frame  rate,  ■c>12  X  512  pixels|  that  also  provid¬ 
ed  a  constant  background  luminance  of  90  cd/m  ’.  The  lumi¬ 
nance  of  the  bars  was  162  cd/nP,  or  approximately  80% 
contrast,  which  was  more  than  10  times  the  contrast  thresh¬ 
old  for  each  stimulus  used.  [Unless  indicated  otherwise, 
contrast  is  defined  to  be  (/.„,„  —  f.hk*rdl/Phkerd.  where  Lhkgni 
is  the  luminance  of  the  background,  which  was  constant  ! 
The  visual  angles  subtended  by  the  two  dimensions  of  each 
har  were  always  proportional  to  the  distance  between  the 
bars,  as  if  only  the  viewing  distance  were  being  changed 
The  relationship  between  bar  size  and  mean  separation  is 
shown  in  Fig  I 

Actually,  both  the  viewing  distance  and  the  stimulus  itself 
were  changed  to  achieve  the  wide  range  of  object  separa 
tions  At  the  smallest  separations,  a  camera  lens  was  also 


used  to  reimage  the  stimulus  at  a  smaller  scale.  When  the 
lens  was  used,  the  stimulus  was  imaged  in  an  aperture  that 
was  surrounded  by  a  large  uniform  field  that  was  illuminated 
to  match  the  screen  approximately  in  brightness  and  hue 
The  effects  on  localization  accuracy  of  viewing  distance  and 
optical  minification  were  checked  by  using  different  combi¬ 
nations  of  viewing  distance,  stimulus  size,  and  optical  mini 
fication  to  achieve  a  single  object  separation  and  bar  size 
No  significant  effects  of  viewing  distance,  per  se,  or  of  the 
lens  were  observed.  Viewing  was  monocular. 

To  prevent  the  observer  from  using  the  distance  to  the 
edge  of  the  screen  as  a  rue,  the  bars  were  kept  well  away  from 
the  edge,  and  the  position  of  the  pair  of  bars  relative  to  the 
edge  was  varied  randomly  from  trial  to  trial  The  adequacy 
of  these  procedures  was  tested  in  experiments  in  which  only 
one  bar  was  presented  and  the  observer  was  required  to 
guess  whether  the  bar  was  a  member  of  a  pair  that  was 
farther  apart  or  closer  together  than  the  average.  When  this 
single-bar  paradigm  was  used,  observers  performed  at 
chance  level  with  all  the  stimulus  configurations  used  in  the 
experiments  reported  here. 

The  method  of  constant  stimuli  was  used  to  measure  local¬ 
ization  accuracy  at  each  of  five  object  separations,  ranging 
from  6.7  to  405  minutes  of  arc  (aremin)  In  a  given  experi 
mental  session,  measurements  were  made  at  a  single  mean 
object  separation  For  each  object  separation,  s,  the  test 
separations  were  s  +  n(As),  for  n  -  ±1  to  ±5.  The  incre¬ 
ment,  As,  was  determined  in  preliminary  experiments  for 
each  observer  and  for  each  value  of  s,  so  that  the  observer 
was  correct  about  90%  of  the  time  when  Ini  =  5.  Kach  of  the 
10  stimuli  was  presented  five  times  in  a  given  session,  and  at 
least  five  sessions  were  conducted  at  each  object  separation, 
yielding  at  least  250  trials  for  each  psychometric  function 
Data  were  collapsed  across  the  sign  of  n.  so  that  a  single 
percent  correct  value  represented  a  given  offset  value  (with 
out  regard  to  whether  the  test  separation  was  that  much 
larger  or  that  much  smaller  than  the  reference  separation) 
Threshold  was  obtained  by  correcting  the  data  for  guessing 
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Fin  1.  Representation  of  the  two-bar  stimulus.  The  size  of  the 
bars  was  scaled  with  the  separation  between  them,  according  to  the 
ratio  shown  here. 

|l percent  correct  —  50)  X  2],  converting  to  probits  to  linear¬ 
ize  the  data,"  using  linear  regression  to  determine  the  best- 
fitting  line  to  the  transformed  data,  and  then  calculating  the 
">0rr  point  on  the  resulting  line. 

On  each  trial,  a  single  pair  of  bars  was  presented.  The 
observer's  task  was  to  determine  whether  the  distance  be¬ 
tween  the  bars  was  more  or  less  than  the  average  object 
separation  that  he  had  seen  during  the  previous  trials, 
Right  wrong  feedback  was  given  after  each  trial  in  the  form 
of  audible  tones.  The  experienced  observers  quickly 
learned  the  standard  and  typically  performed  at  a  stable 
level  after  50  to  100  trials.  At  least  one  practice  session  of  50 
t  rials  was  conducted  at  the  beginning  of  each  data-collection 
period,  and  two  or  more  practice  sessions  (of  50  trials  each) 
were  conducted  whenever  the  mean  object  separation  was 
(hanged.  The  results  of  these  practice  sessions  were  not 
included  in  the  calculations  of  localization  accuracy. 

Localization  accuracy  was  measured  for  three  stimulus 
durations:  102  msec.  408  msec,  and  observer-controlled, 
i  For  brevity,  the  102-  and  408-msec  conditions  will  be  re¬ 
ferred  to  as  the  1(H)-  and  400-msec  conditions,  respectively.) 
In  the  observer-controlled  condition,  the  stimulus  remained 
on  until  the  observer  responded  with  his  decision.  Because 
the  observer  was  encouraged  to  be  correct  as  often  as  possi¬ 
ble.  this  condition  presumably  represents  the  observer’s  op¬ 
timal  performance  that  is.  the  value  of  the  plateau  in  an 
exposure-duration  versus  localization-accuracy  curve. 
Data  for  the  three  conditions  were  collected  in  interleaved 
sessions  for  each  mean  separation  to  avoid  artifacts  arising 
from  day-to-day  variation  in  localization  accuracy. 

During  preliminary  experiments.  1  found  a  high  degree  of 
variability  in  the  HH)  msec  data  when  large  object  separa¬ 
tions  were  used:  The  observer  would  often  not  even  see  one 
or  both  ol  the  briefly  presented  objects.  (The  observer's 
attention  seemed  to  return  to  the  fovea  between  trials,  and 
this  may  have  been  the  cause  I  The  problem  was  alleviated 
hv  presenting  one  bar  for  tOli  msec  before  the  onset  of  the 
other  bar  The  two  bars  then  remained  on  together  for  the 
designated  duration  t  |:>2  or  h>8  msec t  and  were  terminated 
-imultaneouslv.  In  the  observer  controlled  condition,  the 
-t i mull  appeared  simultaneously  I  he  itit>  msec  preview  of 
one  liar  had  no  significant  effect  on  the  results  obtained  at 
-mall  object  separations,  but  it  significant Iv  reduced  the 


variability  of  the  data  obtained  at  large  object  separations 
The  preview  was  used  at  all  object  separations  to  ensure 
comparability  of  the  data. 

B.  Results 

Data  for  two  observers  are  shown  in  Fig.  2  Both  observers 
in  this  experiment  were  naive  to  the  purposes  of  the  experi 
ment.  The  findings  were  also  confirmed  with  the  author  as 
an  observer.  With  the  long  ( i.e  ,  observer-controlled )  expo¬ 
sure  duration,  localization  accuracy  is  essentially  constant 
with  mean  separation,  as  has  previously  been  reported. 
However,  with  brief  exposure  durations,  localization  accura¬ 
cy  is  substantially  poorer  at  small  separations  than  at  large 
In  other  words,  exposure  duration  has  little  effect  on  local¬ 
ization  accuracy  for  mean  separations  larger  than  approxi- 
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Fig  2.  I  vocalization  accuracy  measured  at  a  range  of  ob|r»  t  srpara 
tions  using  liXt  msec.  400  msec,  ami  observer  controlled  exposure 
durations  with  abrupt  onsets  and  terminations  •  a i  Observer  SC, 
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mately  25  arcmin,  whereas  it  has  a  profound  effect  at  smaller 
separations.  The  data  obtained  at  the  smallest  object  sepa¬ 
ration,  6.7  arcmin,  are  consistent  with  several  previous  re¬ 
ports  of  the  effects  of  exposure  duration  in  other  hypera¬ 
cuity  tasks.1-3  The  finding  that  exposure  duration  has  a 
negligible  effect  at  larger  separations  has  not,  to  my  knowl¬ 
edge,  been  reported  previously.  I  will  consider  two  plausible 
explanations  for  the  difference  in  the  exposure  duration 
effects  at  large  and  small  separations:  differences  in  the 
effective  contrasts  of  the  stimuli  used  and  differences  in  the 
spatial-frequency  content  of  the  stimuli. 

3.  CONTRAST  EFFECTS 

Hadani  et  al.4  have  shown  that,  with  briefly  presented  hy¬ 
peracuity  stimuli,  the  effect  of  exposure  duration  on  relative 
localization  can  be  accurately  modeled  in  terms  of  the  effect 
of  exposure  duration  on  stimulus  strength.  Specifically,  if 
contrast  is  decreased  as  exposure  duration  is  increased, 
keeping  stimulus  energy  constant,  then  localization  accura¬ 
cy  is  essentially  constant.  If  the  effects  of  contrast  and 
exposure  duration  also  interact  when  large  separations  are 
used,  then  the  difference  in  exposure-duration  effects  at 
small  and  large  separations  found  here  (Fig.  2)  might  be 
confounded  by  differences  in  the  effective  contrasts  of  the 
small-  and  large-scale  stimuli.  In  particular,  stimuli  with 
high  effective  contrasts  (as  in  the  large-separation  experi¬ 
ments)  might  be  less  susceptible  to  exposure-duration  ef¬ 
fects  than  are  stimuli  with  lower  effective  contrasts  (as  in  the 
small-separation  experiments). 

If  the  lower  localization  accuracy  for  small,  briefly  pre¬ 
sented  stimuli  arose  from  the  lower  effective  contrasts  of 
these  stimuli,  then  equating  the  effective  contrasts  of  the 
stimuli  used  at  all  separations  should  equate  the  localization 
accuracies.  To  test  this  explanation,  I  measured  localiza¬ 
tion  accuracy  over  a  range  of  stimulus  contrasts  and  separa¬ 
tions,  using  a  briefly  presented  stimulus.  The  effective  con¬ 
trasts  of  the  stimuli  were  equated  by  normalizing  the  stimu¬ 
lus  contrast  by  the  detection  threshold.  The  validity  of  this 
normalization  procedure  is  supported  by  the  data  that  re¬ 
sulted. 

A.  Methods 

Localization  accuracy  was  measured  as  a  function  of  stimu¬ 
lus  contrast  at  five  mean  separations  ranging  from  6.7  to  175 
arcmin.  The  experimental  paradigm  was  the  same  as  that 
used  above,  with  the  size  of  the  bars  scaled  to  the  mean 
separation.  However,  in  this  set  of  experiments,  contrast 
was  set  at  1.5,  2,  3,  5,  or  10  times  the  detection  threshold  for 
the  stimulus  being  used.  The  stimuli  were  presented  with 
abrupt  onsets  and  terminations  and  were  on  for  225  msec. 

Contrast-detection  thresholds  were  measured  using  a  yes/ 
no  staircase  procedure,  contrast  being  reduced  if  the  observ¬ 
er  responded  yes  (seen)  and  increased  if  the  observer  re¬ 
sponded  no  (not  seen).  The  contrast  increment  was  10%, 
and  half  of  the  trials  were  blank  to  discourage  false  alarms 
The  stimuli  were  presented  in  the  same  retinal  locations  that 
they  occupied  in  the  localization  tasks.  Threshold  was  ob¬ 
tained  by  taking  the  average  of  at  least  10  contrast  reversals 
The  contrast  thresholds  for  the  various  separations  are  given 
in  Table  1 . 
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B.  Remits  \ 

Figure  3  shows  results  for  all  five  mean  separations  There 
are  several  points  of  interest  in  these  data  First,  at  all 
object  separations,  localization  accuracy  increases  with  in 
creasing  contrast  up  to  about  five  times  the  detection 
threshold  and  then  reaches  a  plateau  Therefore  the  con- 
traat  used  in  the  previous  experiments,  which  was  always 
more  than  10  times  the  detection  threshold,  was  high  enough 
to  eliminate  contrast  effects.  Similar  contrast  effects  were 
reported  previously  by  Watt  and  Morgan"  for  vernier  acuity  £3 

tasks  1 

The  second  point  of  interest  is  that  the  rate  of  increase  in  .‘.i 

sensitivity  with  contrast  and  the  saturation  point  for  this  V3 

contrast  effect  are  similar  for  all  separations  tested  The 
common  curve  shape  validates  the  use  of  the  detection  v' 

threshold  as  a  normalizing  factor  It  also  suggests  that  there  .A 

is  a  single  type  of  mechanism  underlying  localization  at  all  "** 

object  separations  in  this  range.  .  ® 

The  third  point  of  interest  is  that  localization  accuracy  for 
this  brief  exposure  duration  increases  with  increasing  object 
separation  at  all  stimulus  contrasts.  It  is  clear  from  Fig  3 
that  sensitivity  for  the  smallest  separation  used  (6.7  arcmin  i 
is  depressed  relative  to  that  for  larger  separations.  To  show  v’* 

more  clearly  that  the  sensitivity  changes  systematically  j| 

across  separations,  the  data  of  Fig.  3  (excluding  the  6.7 

Table  1.  Contrast  Thresholds  for  Scaled  Stimuli 
(225-msec  Duration).  Observer  SG 
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Fig  4  Localization  as  a  function  of  mean  separation  for  five  con¬ 
trast  levels.  Data  from  Fig.  3.  Observer  SG. 

arcmin  condition)  have  been  replotted  in  Fig.  4,  where  local¬ 
ization  accuracy  is  shown  as  a  function  of  mean  separation 
for  the  various  contrast  levels.  A  linear  ordinate  has  been 
used  to  enhance  visual  clarity.  It  can  be  seen  from  this 
figure  that  localization  accuracy  increases  consistently  up  to 
about  50  arcmin  at  all  stimulus  contrasts. 

The  data  of  Figs.  3  and  4  show  that,  for  a  brief  exposure 
duration,  the  increase  in  localization  accuracy  with  increas¬ 
ing  separation  is  independent  of  the  effective  contrast  of  the 
stimulus.  Therefore  the  difference  in  exposure-duration 
effects  at  large  and  small  separations  is  not  due  simply  to 
differences  in  the  effective  contrasts  of  the  stimuli  used  in 
the  two  conditions. 

4.  SPATIAL-FREQUENCY  EFFECTS 

An  alternative  explanation  for  the  exposure-duration  effects 
reported  above  is  that  they  are  a  suprathreshold  version  of 
the  spatiotemporal  interaction  found  at  the  detection 
threshold.  At  threshold,  information  about  higher  spatial 
I retpiencies  is  integrated  over  a  longer  duration  than  is  infor¬ 
mation  about  lower  spatial  frequencies  '1  Such  spatiotem¬ 
poral  interaction  could  theoretically  account  for  the  ob- 
-erved  results,  because  the  Fourier  transform  of  the  small- 
m  ale  stimulus  has  substantial  energv  at  high  spatial 
frequencies,  whereas  that  ot  the  large  scale  stimulus  does 
not  These  transforms  are  -hnwn  in  F  ig  5  (Qualitatively, 
the  -pat lotemporal  interaction  explanation  is  acceptable 
The  magnitudes  of  the  expo-ore  duration  effects  at  small 
and  large  separat n ms  seen  in  Fig  a. e  -molar  to  the  magni- 
i  udes  ot  the  contrast  threshold  ettect-  'or  high  and  low  spa- 
tial  frequencies,  respeitivelv  '  A  quantitative  comparison 
•  unnof  lie  made  without  a  i  omplele  iheorv  of  how  the  local 
i/atioii  mechanism  uses  various  trcquencv  <  omponents  of 
the  stimulus  However,  experimental  te-t-  .an  lie  made  of 
'  hi-  explanat ion 

It  suprathreshold  -patiotemporal  inter. n  turn  at  a  spatial 
Irequeiuv  -peiiln  level  ot  vi-u.il  pro.  e— mg  is  responsible 
t..r  the  expo- ure  duration  »  ltei  t  oht allied  here,  then  chang 
mg  the  -patial  frequencv  i  .intent  ot  the  stimulus  should 
■  hange  the  exposure  duration  eltects  Specifically,  a  stimu 
lu-  that  consists  of  a  pair  ..t  high  frequency  objects  that  are 
separated  h\  more  than  about  J'.  ar.  nun  should  vield  expu- 
-ure  dural  ion  etfei  t-  t  hat  are  similar  to  those  obtained  with 
re.  tangular  bars  that  are  separated  bv  a  few  minutes  of  arc 


A.  Methods 

To  test  this  explanation,  localization  accuracy  was  measured 
as  a  function  of  exposure  duration  at  a  large  object  separa¬ 
tion  (175  arcmin)  using  high-frequency  bar  stimuli.  Each 
high-frequency  bar  consisted  of  a  25-cycle/deg  grating  whose 
contrast  was  modulated  by  a  one-dimensional  (vertical) 
Gaussian  envelope  with  a  equal  to  9.6  arcmin.  The  width 
and  length  of  the  high-frequency  bars  were  scaled  to  the 
object  separation,  as  in  the  previous  experiments.  The  Fou¬ 
rier  transform  of  this  high-frequency,  wide-separation  stim¬ 
ulus  is  shown  in  Fig.  5(c). 

Contrast  for  the  high-frequency  stimulus  was  raised  to 
90%  to  minimize  contrast  effects.  |For  this  stimulus,  con¬ 
trast  is  defined  to  be  (Tn,u  l'mm)/(^'mBi  T  Lmln).]  To 
determine  where  on  the  curve  of  contrast  versus  localization 
accuracy  this  value  lay,  detection  thresholds  were  measured 
for  these  high-frequency  stimuli  in  the  retinal  locations  that 
they  occupied  in  the  localization  experiments.  The  stimuli 
were  stabilized  on  the  observer’s  retina1011  to  ensure  that  the 
appropriate  retinal  location  was  stimulated.  (This  precau- 


O'  0  5  10  ‘j  0  '0  Sfl 

SPATIAI  iHlUUlNf.v  I  -y  . . 

(•)  17S-ARCI*N  MEAN  SEPARATION.  RECTANGULAR  BARS 


O'  OS  1  0  5  0  >0 

SPaTiai  fHFuuINCV  <v<  **'>*«'" 

<t>l  8  7-ARCMN  ImCAN  SEPARATION,  RECTANGULAR  BARS 


OS  »  0  Ml  "•)  V) 

S*  A  ’  A  l  IHF..JU1M  >  ,  r\  1.q.rr 

C>  17S-ARCMN  fctAN  SEPARATION.  GAUSSIAN  MOOULATED 
HOVEREOUENCY  BARS 

Kir  One  dimensional  Fourier  transforms  of  the  stimuli  used  in 
the  experiments  on  spatial  frequency  effects  (Section  4).  The 
transforms  of  these  simple  stimuli  were  determined  analytically  and 
then  plotted  using  a  standard  plotting  program  on  a  Symbolics 
computer  One  dimensional  transforms  are  appropriate  under  the 
assumptions  that  (O  the  observer  estimates  the  shortest  distance 
between  the  two  bars  and  (2)  the  hars  extend  horizontally  beyond 
the  limits  of  the  relevant  receptive  fields.  These  assumptions  were 
confirmed  bv  unpublished  data  obtained  in  my  laboratory  showing 
that  line  length  has  no  appreciable  affect  on  localization  accuracy. 
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Fig.  6.  Localization  accuracy  as  a  function  of  exposure  duration  for 
two  observers,  (a)  Observer  SG,  (b)  observer  CAB. 

tion  was  more  critical  with  these  higher-frequency  stimuli 
than  it  was  for  the  broadband  stimuli  used  previously.)  De¬ 
tection  thresholds  were  26  and  22%,  respectively,  for  observ¬ 
ers  SG  and  CAB.  Thus  the  90%  contrast  was  3.5  to  4  times 
the  detection  threshold  for  the  100-msec  condition.  Al¬ 
though  this  is  not  on  the  plateau  of  the  contrast  versus 
localization-accuracy  curve  (Fig.  2),  the  residual  contrast 
effect  is  only  a  15-20%  change  in  threshold.  A  difference  in 
thresholds  that  exceeds  about  20%  can  therefore  be  attribut¬ 
ed  to  exposure  duration. 

B.  Results 

Data  for  this  175-arcmin-separation,  high-frequency  bar 
condition  are  shown  in  Fig.  6  together  with  the  comparable 
data  for  the  6.7-  and  50-arcmin  conditions  from  Fig.  2  for 
observer  SG  and  data  for  the  6.7-,  12. 4-,  and  405-arcmin 
conditions  for  observer  CAB. 

Localization  accuracy  for  the  high-frequency,  widely  sepa¬ 
rated  bars  varies  with  exposure  duration  in  a  way  that  mim¬ 
ics  the  exposure-duration  effects  seen  at  small  object  separa¬ 
tions  and  that  differs  substantially  from  the  effects  seen 
previously  at  large  object  separations.  Furthermore,  this 
effect  is  significantly  larger  than  the  residual  contrast  effect 
for  these  stimuli  and  hence  cannot  be  attributed  solely  to  a 


change  in  effective  contrast  with  change  in  exposure  dura¬ 
tion.  The  similarity  of  the  small-separation  data  and  the 
high-frequency,  large-separation  data  implies  that  the  effect 
of  exposure  duration  is  not  related  primarily  to  the  separa¬ 
tion  between  the  objects  but  rather  is  related  to  the  spatial- 
frequency  content  of  the  objects  themselves.  These  data 
suggest  that  it  is  not  the  localization  mechanism  per  se  that 
is  continuing  to  acquire  information  at  the  longer  durations; 
instead  it  is  a  mechanism  (or  set  of  mechanisms)  that  pre¬ 
cedes  localization  and  that  integrates  information  about  dif¬ 
ferent  spatial  frequencies  at  different  rates. 

5.  DISCUSSION 

The  earliest  report  of  the  effects  of  exposure  duration  on 
localization  accuracy1  was  concerned  with  determining  the 
role  of  eye  movements  in  vernier  acuity.  If  spatial  integra 
tion  played  an  important  role  in  vernier  acuity  (the  “dyna¬ 
mic”  theory),  then  stabilizing  the  retinal  image  should  have 
a  larger  effect  at  long  than  at  small  exposure  durations.  It 
did  not,  and  the  dynamic  theory  of  vernier  acuity  suffered  a 
blow,  but  .he  effect  of  exposure  duration  on  localization 
accuracy  remained  as  an  important  phenomenon  to  be  ex¬ 
plained. 

This  exposure-duration  effect  has  usually  been  attributed 
to  the  fact  that  localization  is  a  more  complex  process  than 
simple  detection;  however,  that  attribution  does  not  explain 
the  phenomenon.  The  results  reported  here  suggest  that 
the  effects  of  exposure  duration  on  localization  occur  at  a 
site  of  processing  in  which  the  spatial-frequency  content  of 
the  individual  stimuli  is  fundamental  to  their  represents 
tion.  An  obvious  candidate  is  the  processing  site  that  is 
responsible  for  frequency-specific  pattern  adaptation  and 
masking  effects  as  modeled  by  Thomas,12  Wilson  and  Ber 
gen,13  Watson,14  Sakitt  and  Barlow,15  and  others.  The  cause 
of  the  exposure-duration  effect  may  simply  be  an  improved 
signal-to-noise  ratio  in  the  output  of  this  frequency-channel 
stage,  as  has  been  suggested  by  Klein  and  Levi18  to  account 
for  the  effect  of  contrast  on  localization.  In  this  scheme, 
determination  of  the  relative  positions  of  objects  occurs  sub 
sequent  to  the  frequency-channel  stage  of  visual  processing. 
Alternatively,  the  exposure-duration  effect  might  be  ac¬ 
counted  for  in  terms  of  statistical  sampling,  as  has  been  done 
for  contrast  effects  by  Watt  and  Morgan.8 

The  data  reported  above  indicate  that  the  signal-to-noise 
ratio  does  improve  with  increasing  exposure  duration  (for 
durations  longer  than  about  100  msec)  but  only  for  the  high 
spatial  frequencies  in  the  stimulus.  This  finding  is  consis¬ 
tent  with  the  results  of  an  early  study  by  Hood17  and  sup 
ports  the  conclusion  drawn  by  Morgan  et  a/.18  from  their 
comparison  of  exposure-duration  effects  for  stationary  and 
for  moving  hyperacuity  targets.  Morgan  et  at.  found  no 
effects  of  exposure  duration  on  the  moving  targets  and  repli 
cated  previous  findings  of  a  large  effect  with  stationary  tar¬ 
gets  (as  also  replicated  here).  They  concluded  that  expo¬ 
sure  duration  affects  the  high-frequency  components  of  the 
stimuli,  which  are  blurred  by  the  stimulus  motion,  and  not 
the  low-frequency  components,  which  are  less  affected  by 
stimulus  motion. 

In  summary,  localization  accuracy  appears  to  be  a  con¬ 
stant  function  of  mean  separation  at  both  long  and  short 
exposure  durations,  provided  that  the  spatial  frequency 
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content  of  the  objects  being  localized  is  sufficiently  similar. 
Furthermore,  this  relationship  is  independent  of  stimulus 
contrast  when  that  contrast  is  expressed  as  a  multiple  of  the 
detection  threshold.  Localization  accuracy  improves  with 
increasing  contrast  in  the  same  way  for  all  mean  separations 
tested,  ranging  from  the  hyperacuity  region  (6.7  arcmin)  to 
large  separations  (405  arcmin).  The  results  suggest  that  the 
effects  of  exposure  duration  on  hyperacuity  thresholds, 
which  have  been  widely  studied,  are  linked  to  the  spatial- 
frequency  content  of  the  stimulus  and  not  to  the  localization 
task  per  se.  The  localization  process  appears  to  be  sensitive 
to  the  quality  of  the  signal  that  it  receives,  but  this  process  is 
unable  to  improve  the  quality  of  the  information  it  receives 
by  further  temporal  integration. 
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Abstract  -  Large-scale  localization  accuracy  is  measured  with  objects  that  stimulate  different  ranges 
of  spatial  frequencies.  The  author  has  previously  made  measurements  using  objects  that  stimulate 
only  high-spatial-frequency  channels  or  only  low-spatial-frequency  channels  and  found  no  effect  of 
spatial  frequency.  In  the  present  study,  localization  accuracy  is  measured  with  an  object  pair 
consisting  of  a  low-spatial-frequency  object  and  a  high-spatial-frequency  object.  Localization 
accuracy  for  this  cross-channel  stimulus  is  as  high  as  for  the  same-channel  stimuli  used  previously, 
showing  that  the  localization  mechanism  operates  effectively  across  spatial  frequency  channels. 
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In  a  previous  study  (Burbeck,  1987),  I  reported  that  over  a  large  range  of  spatial  frequencies, 
the  spatial  frequency  content  of  widely  separated  objects  does  not  affect  localization  of  those 
objects,  provided  the  signal  strength  of  the  objects  is  kept  constant.  This  conclusion  was  also 
drawn  by  Toet  et  al.  (1987)  in  a  concurrent  study.  In  both  studies,  the  two  objects  being  localized 
were  always  identical;  e.g.  both  were  Gaussian-modulated  high-spatial-frequency  (HSF)  bars,  or 
both  were  low-spatial-frequency  (LSF)  Gaussian  bars.  Those  experiments  left  open  this  question: 
Can  large-scale  localization  be  done  accurately  if  the  objects  being  localized  do  not  stimulate  the 
same  type  of  frequency  channel?  For  example,  if  one  object  stimulates  only  HSF  channels  and 
the  other  only  LSF  channels? 

To  answer  this  question,  I  measured  large-scale  localization  accuracy  with  an  HSF/LSF 
stimulus  pair  and  compared  the  results  to  localization  accuracy  measured  with  a  pair  of  HSF 
stimuli  and  with  a  pair  of  LSF  stimuli.  All  stimuli  were  horizontal  bars,  5.5  deg  long,  with  an 
average  vertical  separation  of  173  aremin.  (Because  of  equipment  limitations,  all  stimuli  had 
rectangular  contrast  profiles  in  the  direction  orthogonal  to  the  direction  of  the  distance  judgment.) 
The  method  of  constant  stimuli  was  used  with  a  single  separation  presented  on  each  trial. 

Observers  judged  the  vertical  separation  between  the  bars,  reporting  whether  it  was  greater  or  less 
than  the  average  separation  they  had  seen  on  previous  trials.  Auditory  right/wrong  feedback  was 
given  after  every  trial. 

The  HSF  object  was  a  strip  of  21  c/deg  horizontal  grating  whose  contrast  in  the  vertical 

direction  was  modulated  by  a  Gaussian  envelope  (with  a  =  1 1.4  aremin).  The  LSF  stimulus  was  a 

horizontal  bar  whose  vertical  luminance  profile  was  Gaussian  (a  =  1 1.4  aremin).  Exposure 
duration  was  500  msec  (with  abrupt  onset  and  offset)  to  enhance  sensitivity  to  the  HSF  objects 
Contrast  was  maintained  at  90%  to  ensure  that  localization  accuracy  was  optimal  for  both  the  HSF 
and  LSF  stimuli.  All  other  details  of  the  experiments  were  identical  to  those  reported  previously 
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(Burbeck,  1987). 

Figure  1  shows  the  psychometric  functions  for  localization  under  three  conditions: 
HSF/HSF,  LSF/LSF,  and  HSF/LSF  object  pairs.  Data  are  shown  for  two  observers,  both  of 
whom  were  naive.  Localization  accuracy  is  the  same  for  the  LSF  pair  as  for  the  HSF  pair, 
confirming  the  conclusion  of  the  previous  studies.  The  new  finding  is  that  localization  accuracy 
also  remains  the  same  if  an  HSF/LSF  pair  is  used. 


(A) 
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Fig.  1.  Psychometric  functions  for  localization  of  objects  separated  by  an  average  of  173  aremin.  Objects  are  both 
low  spatial  frequency  (triangles),  both  high  spatial  frequency  (open  squares,)  or  one  is  high  spatial  frequency  and  one 
low  spatial  frequency  (filled  squares).  The  data  have  been  corrected  for  guessing  by  the  formula  (Original  Percent 
Correct  -  50)  x  2.  Data  for  two  observers  are  shown. 

It  has  been  suggested  that  results  such  as  these  and  HSF  perceptual  grouping  phenomena 
(Janez,  1984;  Carlson  et  al..  1984)  can  be  accounted  for  by  assuming  that  there  is  a  nonlinear 
process  that  allows  LSF  channels  to  respond  to  HSF  stimuli  (Peli,  1987).  The  nonlinearity 
invoked  is  the  one  known  to  occur  in  the  initial  transduction  of  luminance.  However,  that 
nonlinearity  is  quite  weak  over  the  small  range  of  luminances  present  in  the  stimuli  used  here 
(Shapley  and  Enroth-Cugell,  1984).  Furthermore,  I  have  shown  previously  that  when  the  objects 
are  HSF  stimuli,  localization  accuracy  increases  with  increasing  exposure  duration,  whereas  it  does 
not  when  they  are  LSF  stimuli  (Burbeck,  1987).  Thus,  it  is  unlikely  that  LSF  channels  are 
responsible  for  localization  of  both  types  of  stimuli.  A  much  more  plausible  assumption  is  that 
different  frequency  channels  are  involved. 
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The  results  of  previous  experiments  showed  that  the  large-scale  localization  process  can 
operate  equally  well  on  the  responses  of  either  LSF  or  HSF  channels.  The  present  result  shows 
that  it  can  operate  as  accurately  across  channel  types  as  it  can  within  a  single  channel  type.  Thus, 
theories  of  spatial  vision  that  postulate  multiple  independent  channels  at  each  retinal  location 
(Graham  et  al..  1978;  Wilson,  1978;  Wilson  and  Bergen,  1979,  and  others  since),  must  allow  the 
localization  process  to  operate  across,  not  just  within,  channels.  More  generally,  the  finding 
reported  here  reinforces  the  idea  that  large-scale  localization  is  a  fairly  high-level  process,  being 
insensitive  to  those  aspects  of  the  retinal  image  that  appear  to  be  most  important  in  detection  tasks. 
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Although  orientation  sensitivity  is  clearly  evident  in  contrast  thresholds  of  one-dimensional 
gratings,  I  find  no  orientation  sensitivity  at  the  level  of  suprathreshold  localization  judgments.  This 
conclusion  is  supported  by  three  pieces  of  evidence:  First,  localization  accuracy  does  not  vary 
reproducibly  with  orientation.  Second,  the  result  still  holds  when  the  stimuli  are  misaligned  relative 
to  the  measurement  axis.  To  test  this,  one  of  the  objects  to  be  localized  is  randomly  misaligned 
relative  to  the  measurement  axis;  the  observer’s  task  is  to  infer  the  distance  between  the  targets 

along  the  measurement  axis.  Observers  can  infer  the  distance  along,  for  example,  a  15°  angle,  as 
well  as  they  can  inter  the  vertical  distance.  Third,  localization  thresholds  for  misaligned  stimuli  are 
higher  at  all  orientations  than  those  for  aligned  stimuli  by  an  amount  that  can  be  completely 
accounted  for  under  the  assumption  that  the  localization  mechanism  is  isotropic. 
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L  Introduction 

Localization  —  our  ability  to  determine  the  relative  positions  of  objects  -  has  received 
increasing  attention  in  recent  years.  Westheimer  was  one  of  the  early  active  proponents  of  the 
importance  of  this  ability,1  and  Morgan  and  Watt,2  Klein  and  Levi,3  and  Hirsch  and  Hylton,4 
among  others,  have  also  made  major  contributions.  Why  is  this  visual  ability  of  such  interest? 
Historically,  it  has  been  a  major  subject  of  inquiry  primarily  because  localization  thresholds  can  be 
subcellular  in  size,  i.e.,  smaller  than  the  width  of  the  foveal  cones  that  are  detecting  the  stimuli. 

The  challange  posed  by  this  fact  prompted  Westheimer  to  coin  the  term  hyperacuity  and  prompted 
many  investigators  to  seek  an  explanation. 

Extremely  small  thresholds,  however,  are  obtained  only  when  the  objects  to  be  localized 
are  separated  by  a  few  minutes  of  arc.5  Much  more  common  in  our  daily  experience  are  object 
separations  of  degrees  or  tens  of  minutes  of  arc,  so  one  must  ask  whether  the  localization  process 
that  is  being  investigated  in  hyperacuity  studies  is  also  responsible  for  the  larger-scale  tasks. 

If  the  small-  and  large-scale  localization  processes  are  fundamentally  different,  6  then 
large-scale  localization  should  be  studied  in  its  own  right.  If  they  are  not  fundamentally  different,7 
then  studies  of  the  large-scale  task  may  yield  information  about  the  common  underlying  process 
that  is  not  easily  accessible  from  studies  using  small-scale  stimuli.  The  problem  with  small-scale 
stimuli  is  that,  the  properties  of  the  localization  process  may  be  obscured  by  local  spatial 
interactions  at  stages  of  visual  processing  distal  to  the  site  of  localization,  e.g.  at  the  retina  itself.3 
This  confounding  does  not  occur  with  large-scale  stimuli,  where  the  object  separation  and  the  local 
spatial  characteristics  of  the  stimulus  can  be  manipulated  independently.8,9 

In  the  research  reported  here,  I  take  advantage  of  the  additional  flexibility  afforded  by 
large-scale  stimuli  to  study  the  orientation  selectivity  of  the  localization  process  with  objects  that  are 
locally  isotropic,  i.e.  the  individual  objects  are  isotropic,  although  together  they  form  an  oriented 
stimulus.  If  the  initial  stage  of  cortical  spatial  processing  consists  of  neurons  that  are  selectively 
sensitive  to  a  limited  range  of  orientations,  as  is  generally  believed,10  then  the  use  of  a  locally 
isotropic  stimulus  becomes  especially  important  If  the  stimulus  were  locally  oriented,  then  the 
orientation  selectivity  of  this  initial  cortical  stage  could  affect  the  results,  even  if  the  localization 
process  itself  were  not  sensitive  to  orientation.  Thus,  using  a  locally  isotropic  stimulus  allows  any 
orientation  selectivity  found  in  the  localization  results  to  be  attributed  unambiguously  to  the 
localization  mechanism.  For  this  reason,  in  the  experiments  reported  here,  I  used  locally  isotropic 
stimuli  to  determine  whether  the  process  underlying  the  localization  of  widely  separated  objects  is 
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n.  Effect  of  Orientation  on  Localization  Accuracy 

Orientation  selectivity  has  previously  been  found  in  orientation  discrimination1 1  and  in 
contrast  detection.12  One  indication  of  orientation  selectivity  is  lower  thresholds  for  visual  tasks 
with  vertical  and  horizontal  than  with  oblique  orientation  of  the  stimuli.  Following  this  lead,  we 
might  suppose  that,  if  the  localization  process  is  sensitive  to  the  orientation  of  the  measurement 
axis,  then  localization  accuracy  might  also  vary  with  orientation.  The  following  experiment  tests 
this  possibility. 

Methods 

Localization  accuracy  was  measured  using  a  pair  of  small  squares  separated  by  an  average 
distance  of  100  ancmin  edge  to  edge.  (Hardware  limitations  prevented  us  from  using  disks.)  Each 
square  was  5x5  arcmin  (without  taking  the  optical  point  spread  function  of  the  eye  into  account) 
and,  because  of  its  small  size,  had  no  strong  apparent  orientation.  The  large  object  separation  made 
it  unlikely  that  the  two  objects  were  detected  by  a  common  unit  at  distal  stages  of  visual  processing, 
e.g.  at  an  oriented  spatial-frequency-channels  stage.  Thus,  we  assume  that  the  stimulus  was 
effectively  isotropic  at  any  such  stages. 

The  stimuli  were  displayed  on  a  high-resolution  monitor  (Conrac  2400  Cl 9,  5 12x5 12 
pixels,  60  Hz  noninterlaced).  The  background  luminance  was  78  cd/m2  and  the  dots  were  set  at 
90%  contrast  (that  is,  when  the  entire  screen  was  set  at  the  luminance  value  of  the  dots,  the  screen 
measured  140  cd/m2).  The  observers  viewed  the  display  through  a  dove  prism  that  was  rotated  to 
achieve  the  various  orientations  used.  The  display  surround  was  circular  and  the  room  was  dark. 
Viewing  was  monocular. 

The  method  of  constant  stimuli  was  used  with  14  object  separations  ranging  from  91  to  109 
arcmin,  unless  otherwise  indicated.  The  observer's  task  was  to  indicate  on  each  trial  whether  the 
pair  of  dots  was  closer  together  or  farther  apart  than  the  average  separation  he  had  seen  on  previous 
trials.  Auditory  right/wrong  feedback  was  given  after  every  trial.  Practice  trials  were  conducted 
prior  to  data  collection  to  teach  the  observer  the  reference  distance.  Each  stimulus  was  presented 
five  times  in  a  given  session.  At  least  five  sessions  were  conducted  in  each  condition  for  each 
observer,  yielding  350  or  more  trials  per  calculated  threshold.  Thresholds  were  calculated  by 
correcting  the  data  for  guessing  [(percent  correct-50)x2],  converting  to  probits,13  and  then  using 
linear  regression  to  find  the  line  that  best  fitted  the  transformed  data.  The  50%  value  on  this  line 
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was  taken  as  the  threshold  separation,  As.  Threshold  is  plotted  as  As/s,  in  percent,  where  s  is  the 
average  object  separation. 


Results 

Figure  1  shows  data  for  both  observers.  The  error  bars  indicate  plus  and  minus  on  standard 
error.13  Sensitivity  is  significantly  higher  for  one  observer  than  for  the  other.  The  observer  with 
the  higher  thresholds  was  experienced,  whereas  the  other  observer  was  quite  inexperienced.  Thus, 
the  difference  in  thresholds  was  not  due  to  practice.  I  have  no  explanation  for  the  difference,  but 
have  found  this  magnitude  of  intersubject  variability  with  other  subjects  in  similar  tasks. 


V  H 


Orientation 


Fig.  1  Localization  accuracy  as  a  function  of  the  orientation  of  the  measurement  axis.  Open  symbols,  observer  SC 
Filled  symbols,  observer  AM.  Repeat  measurements  were  made  for  observer  SG.  V  indicates  vertical 
measurement  axis,  H,  horizontal. 


Both  observers  showed  some  slight  variation  in  threshold  with  orientation  during  the  initial 
measurements.  Repeat  measurements  were  made  on  observer  SG,  and  the  pattern  of  variation  was 

not  replicated,  as  can  be  seen  in  Fig.  1,  The  psychometric  functions  for  repeat  measurements  at  0° 


15°,  30°,  and  45°  are  shown  in  Fig.  2.  (Observer  AM  was  unavailable  for  further  testing.) 
Collectively,  the  data  suggest  that  there  is  no  significant  difference  in  localization  accuracy  across 
orientation,  at  least  if  the  observer  is  given  sufficient  practice  on  the  task.  Therefore,  it  is 
reasonable  to  make  the  more  parsimonious  assumption  of  an  isotropic  model  of  localization. 
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Fig.  2  Psychometric  functions  for  localization  obtained  at  0°  (open  squares),  1 5°  (Filled  diamonds),  30°  (filled 
squares),  and  45°  (open  diamonds).  The  data  have  been  corrected  for  guessing.  Observer  SG. 
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HI.  Localization  with  Nonaligned  Stimuli 

For  a  further  test  of  the  hypothesis  that  the  localization  mechanism  is  isotropic,  we  devised 
the  following  experimental  paradigm. 

The  idea  was  to  create  a  task  in  which  the  localization  judgment  required  orientation 
information  explicitly.  The  stimulus  configuration  is  shown  diagramatically  in  Fig.  3.  In  the 
condition  represented  in  this  figure,  the  observer's  task  was  to  infer  the  vertical  distance  between 
the  two  dots;  the  horizontal  position  of  the  bottom  dot  was  varied  from  trial  to  trial.  This 
measurement  was  repeated  at  a  range  of  orientations  of  the  measurement  axis.  The  lower  dot  was 
always  displaced  orthogonally  to  the  measurement  axis.  (That  is,  the  entire  stimulus  was  rotated  to 
each  new  orientation.) 

There  are  two  fundamentally  different  ways  in  which  this  task  could  be  done.  First, 
if  the  localization  process  is  an  oriented  mechanism,  e.g.  a  mechanism  of  the  type  postulated  to 
account  for  contrast  detection,  then  it  consists  of  oriented  subprocesses,  each  of  which  has 
receptive  fields  that  are  elongated  in'  the  direction  orthogonal  to  their  measurement  axes.  These 
oriented  subprocesses  should  be  essentially  insensitive  to  variation  in  the  position  of  a  dot  over  a 
considerable  distance  in  the  direction  orthogonal  to  the  measurement  axis.  If  localization  of  widely 
separated  objects  is  done  by  processes  with  such  large,  oriented,  receptive  fields,  then  observers 
should  be  able  to  infer  the  projected  distances  nearly  as  well  as  they  judge  actual  interobject 
distances. 

Furthermore,  if  the  localization  mechanisms  are  oriented,  they  may  be  tuned  to  only  a  few 
orientations.  If  so,  observers  may  be  able  to  infer  projected  distances  better  along  some 
orientations  than  along  others.  A  priori  it  would  seem  likely  that  observers  could  infer  distances 
projected  onto  the  vertical  or  horizontal  more  accurately  than,  for  example,  distances  projected  onto 

an  angle  that  is  15°  to  the  vertical. 

On  the  other  hand,  if  the  localization  mechanism  is  isotropic,  then  the  only  data  that  it  can 
convey  is  the  actual  distance  between  the  objects  (s,  in  Fig.  3).  Thus,  if  the  observer  did  not  take 
into  account  the  obvious  orthogonal  variation  in  the  lower  dot’s  position,  then  his  responses  would 
be  determined  solely  by  his  judgment  of  the  distance,  s.  This  would  result  in  a  large  decrease  in 
accuracy  relative  to  the  aligned  condition.  His  performance  would  be  improved  if  he  estimated  the 
orthogonal  displacement  (or  the  orientation  of  the  two  dots)  and  adjusted  his  responses 
accordingly.  (Quantitative  details  relating  to  this  alternative  are  considered  in  Section  IV.)  For 
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now,  I  simply  observe  that  if  the  localization  mechanism  is  isotropic,  then  accuracy  should  be 
reduced  by  the  introduction  of  random  orthogonal  displacement  of  one  dot. 
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Fig.  3  Randomly  misaligned  stimulus.  The  observer's  task  was  to  determine  the  projected  distance  y  between  the 
two  objects.  One  dot  was  displaced  in  the  direction  orthogonal  to  the  direction  of  measurement  by  an 
amount  that  varied  randomly  from  trial  to  trial  over  the  range  -87  and  +87  arc  min  from  the  measurement 
axis.  The  average  distance  between  the  objects  projected  along  the  measurement  axis  (which  in  this  drawing 
is  vertical)  was  100  arc  min.  The  targets  are  not  drawn  to  scale. 

Methods 

Localization  accuracy  was  measured  using  a  pair  of  dot  stimuli  as  shown  in  Fig.  3.  The 
equipment  and  experimental  designs  were  the  same  as  those  used  in  the  previous  experiments. 
However,  in  these  experiments  the  lower  dot  (the  rightmost  dot  for  a  horizontal  measurement  axis) 
was  displaced  randomly  from  trial  to  trial  in  the  direction  orthogonal  to  the  measurement  axis  by  a 
distance  in  the  range  ±87  aremin.  The  observer  knew  the  nominal  orientation  of  the  measurement 
axis  but  he  acquired  a  more  precise  estimate  of  it  during  practice  trials.  The  observer's  task  was  to 
report,  on  each  trial,  whether  the  projected  separation  along  the  measurement  axis  was  greater  or 
less  than  the  average  projected  separation.  This  judgment  had  to  be  made  in  the  presence  of  large 
trial-to-trial  variations  in  the  orientation  of  the  dot  separation  (s,  in  Fig.  3).  Despite  the  large 
random  misalignments,  observers  quickly  learned  the  task;  one  practice  session  of  70  trials  was 
found  to  be  sufficient  to  reach  a  stable  level  of  performance. 
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Results 


Data  for  both  observers  are  shown  in  Fig.  4.  Contrary  to  intuition,  we  saw  no  systematic 
variation  in  accuracy  with  orientation  of  the  measurement  axis.  Although  one  observer  shows  a 
tendency  to  have  higher  thresholds  for  more  horizontal  orientations,  this  trend  is  not  evident  in  the 
other  observer.  In  general,  thresholds  are  not  lower  at  the  horizontal  and  vertical  orientations  than 
they  are  at  the  obliques.  For  example,  both  observers  can  estimate  a  distance  projected  on  an  angle 

of  15°  as  well  as  they  can  estimate  a  distance  projected  on  the  vertical  (0°).  Thus,  there  is  no 
evidence  for  a  set  of  oriented  mechanisms  tuned  to  only  a  few  orientations.  Furthermore,  randomly 
misaligning  the  objects  results  in  a  substantial  change  of  the  localization  threshold,  which  was 
elevated  by  an  average  of  1.5x  for  one  observer  and  2.5x  for  the  other.  This,  too,  might  suggest 
the  absence  of  orientation-selective  mechanisms,  as  argued  above,  but  a  more  quantitative  analysis 
is  required  to  draw  clear  conclusions.  Such  an  analysis  is  reported  in  Section  IV. 


i  i 


i  ^  i 
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IV.  Isotropic  Prediction  for  Misaligned  Condition 

A.  Simple  Prediction 

Can  an  isotropic  localization  process  account  for  the  threshold  elevation  produced  by 
randomly  misaligning  one  of  the  objects?  This  question  can  be  answered  quantitatively  with  very 
few  assumptions. 

If  the  localization  mechanism  is  isotropic,  it  can  provide  information  only  about  the  actual 
interobject  distance  (s,  in  Fig.  3).  Information  about  the  lateral  position  of  the  lower  dot  could  be 
contributed  via  other  visual  mechanisms,  but  let  us  assume  for  the  moment  that  it  is  not.  The 
observer's  performance  in  the  misaligned  condition  should  then  be  predictable  from  his 
performance  on  the  aligned  condition,  because  the  same  visual  information  is  being  used  in  both 
cases.  This  "simple  isotropic  prediction"  of  the  misaligned-condition  results  can  easily  be 
calculated  and  then  compared  to  the  observer's  actual  data  on  this  condition,  as  described  below. 
This  simple  analysis  is  not  sufficient,  but  we  include  it  because  it  provides  a  basis  for  the 
subsequent  analysis. 

The  first  step  in  calculating  the  simple  isotropic  prediction  is  to  determine  what  the  auditory 
feedback  would  mean  to  the  observer  if  he  were  judging  s  instead  of  y.  Because  the  observer's 
nominal  task  was  to  judge  the  distance  y,  the  feedback  indicated  he  was  correct  if  he  responded 
"closer"  when  y  was  less  than  100  arc  min  and  "farther"  if  y  was  >100  arc  min.  However,  when 
considered  in  terms  of  the  value  of  s,  the  feedback  was  probabilistic.  The  calculation  required  to 
determine  the  probability  that  a  response  of  "closer"  was  correct  for  each  value  of  s  is  shown 
schematically  in  Fig.  5,  using  a  vertical  orientation  as  an  example. 


i>  1  ' 
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Fig.  5  Sketch  of  feedback  calculation. 

The  solid  bold  arc  in  Fig.  5  represents  a  constant  value  of  s.  The  horizontal  and  vertical  lines 
labeled  y^,  ymax,  x,,^,  and  x,^  are  limits  of  the  range  of  positions  that  the  lower  dot  could 
occupy.  The  ordered  pair  (0,0)  represents  the  upper  dot.  The  response  "closer"  was  connect  when 
the  curve  lay  in  the  cross-hatched  region  ( i.e.  between  x^  and  Xj  and  between  x2  and  x  3,)  and 

incorrect  when  it  lay  in  the  dotted  region  (i.e.  between  Xj  and  x2).  We  calculated  the  percentage  of 

the  time  that  "closer"  was  the  correct  response  by  dividing  the  sum  of  the  lengths  of  the  arcs  lying 
within  the  cross-hatched  region  by  the  total  arc  length  within  the  stimulus  range.  The  results  of  this 
calculation  show  that  "closer"  was  more  likely  to  be  the  correct  response  for  s  <103  arcmin,  and 
"farther"  was  more  likely  to  be  correct  for  s  >103.  (Details  of  the  calculation  are  given  in  Appendix 
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A.)  Thus,  s  =  103  arc  min  was  the  optimum  crossover  point  if  the  observer  made  his  judgments 
solely  on  the  basis  of  s,  ignoring  the  lateral  position  of  the  lower  dot  This  is  the  assumption  used 
in  the  simple  isotropic  model. 

The  accuracy  with  which  each  observer  can  judge  the  distance  s  is  given  by  the  observer's 
psychometric  function  for  the  aligned  condition.  This  function  is  independent  of  orientation  (Fig. 
1),  and  it  scales  with  the  average  value  of  s  over  a  large  range.8  Therefore,  a  single  representative 
psychometric  function  for  the  aligned  condition  covers  all  orientations  and  a  wide  range  of  mean 
separations.  The  psychometric  function  that  was  used  in  these  calculations  to  represent  the  aligned 
condition  was  obtained  by  averaging  each  observer’s  data  across  orientations.  The  calculation  was 
simplified  by  using  the  percentage  of  "closer"  responses  instead  of  the  standard  percentage  correct. 
(The  psychometric  functions  shown  earlier  considered  percent  correct,  independent  of  what  the 
correct  response  was.)  Linear  interpolation  was  used  to  connect  the  data  points  that  defined  the 
function.  The  function  was  then  translated  and  scaled  so  that  its  50%  value  was  103  (the 
cross-over  point  for  the  simple  isotropic  model). 

The  hypothesis  being  tested  is  that  the  observer  uses  the  value  of  s,  not  y,  in  making  his 
judgment  and  that  he  completely  ignores  the  orthogonal  position  of  the  lower  dot  To  determine 
what  his  responses  would  be  in  this  case,  we  rotated  the  psychometric  function  for  the  aligned 
condition  around  the  upper  dot  [by  substituting  (x2+y2)1/2  for  s).  A  sketch  demonstrating  this 
revolution  and  its  intersection  with  the  range  covered  by  the  stimuli  is  shown  in  Fig.  6.  The  circles 
are  constant  values  of  s  and  hence  represent  constant  values  of  percentage  of  "closer"  responses. 
These  curves  indicate  the  shape  of  the  rotated  psychometric  functior.  The  cross-hatched  area 
indicates  the  range  of  positions  actually  occupied  by  the  lower  dot  The  simple  isotropic  prediction 
for  the  misaligned  condition  is  obtained  by  integrating  across  the  rotated  psychometric  function  at 
fixed  values  of  y,  and  dividing  by  the  horizontal  extent  of  the  surface  x^)  to  obtain  the 

average  height  of  the  surface  at  each  value  of  y.  This  gives  the  probability  that  the  observer 
responded  "closer”  for  each  value  of  y.  The  details  of  these  calculations  are  given  in  Appendix  B. 
The  results  of  these  calculations  are  shown  by  the  solid  lines  in  Fig.  7.  Also  shown  are  each 
observer  s  data  for  the  misaligned  condition.  The  data  curves  shown  are  the  average  of  the 

psychometric  functions  obtained  at  orientations  of  0°,  15°,  30°,  and  45°  in  the  misaligned 
condition  for  each  observer. 
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Fig.  7  Simple  isotropic  predictions  for  the  misaligned  condition,  solid  lines.  Also  shown  for  comparison,  open 
squares,  are  each  observer's  data  for  the  misaligned  condition. 
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The  simple  isotropic  prediction  clearly  differs  from  the  observers'  data.  It  predicts  lower 
accuracy  than  was  actually  achieved.  Thus,  if  the  localization  mechanism  is  isotropic,  the  observer 
must  be  making  some  use  of  his  knowledge  of  the  lateral  position  of  the  lower  dot  (that  is,  of  the 
orientation  of  the  stimulus  axis).  What  is  a  reasonable  assumption  to  make  about  the  nature  of  that 
knowledge?  If  the  observer  had  perfect  knowledge  of  the  orthogonal  position,  then  his 
performance  would  equal  that  for  the  aligned  condition.  If  he  had  no  knowledge  (as  was  assumed 
in  the  simple  isotropic  prediction),  then  his  performance  would  be  well  below  that  achieved  (as 
illustrated  in  Fig.  7).  If  he  had  imperfect  knowledge,  his  performance  would  be  somewhere 
between  these  extremes.  The  problem  then  is  to  estimate  the  accuracy  of  that  knowledge. 

B.  Three-Interval  Isotropic  Prediction 

To  avoid  the  problem  of  adjusting  the  assumptions  until  they  fit  the  data,  I  made  a  single  c 
priori  assumption.  I  assumed  that  the  observer  could  accurately  assign  the  absolute- value  of  the 
orthogonal  displacement  of  the  lower  dot  into  one  of  three  equal  intervals.  The  value  three  was 
initially  chosen  intuitively.  It  was  subsequently  tested  experimentally,  as  reported  below.  No 
published  data  were  available  on  the  accuracy  with  which  observers  can  make  such  judgments  In 
particular,  the  judgments  required  here  are  not  the  same  as  those  required  in  orientation 
discrimination  or  vernier  acuity  tasks. 

With  this  tripartite  information  about  the  lateral  position,  the  observer  could  use  the 
feedback  to  determine  three  crossover  values,  one  for  each  of  the  three  ranges  of  orthogonal 
displacement,  and  hence  improve  his  performance.  The  calculations  for  this  three-interval 
prediction  are  similar  to  those  required  for  the  isotropic  prediction.  The  predictions  for  the  two 
observers  are  shown  in  Fig.  8,  together  with  each  observer's  data  for  the  misaligned  condition 

For  Observer  SG,  the  accuracy  predicted  by  the  three-interval  isotropic  model  is  a  good 
approximation  to  the  data;  for  Observer  AM,  the  predicted  accuracy  is  higher  than  that  actually 
achieved.  Although  changing  the  number  of  intervals  could  improve  the  fit  for  Observer  AM,  it 
would  make  it  worse  for  Observer  SG.  Thus,  the  a  priori  choice  of  three  intervals  seems  to  have 
been  a  good  one,  and  that  choice  makes  the  model  approximately  correct  However,  the  agreement 
of  the  isotropic  prediction  and  the  misaligned  data  depends  heavily  on  the  accuracy  of  the 
observer's  information  about  the  orthogonal  position.  Therefore,  it  is  important  to  test  the 
assumption  that  the  observer  can  accurately  assign  the  orthogonal  position  of  the  lower  dot  into  one 
of  three  intervals  (each  side  of  center). 
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Fig.  8  Three-interval  isotropic  prediction  for  the  misaligned  condition,  solid  lines.  Also  shown  for  comparison, 
by  the  open  squares,  art  each  observer's  data  for  the  misaligned  condition. 
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C.  Test  of  the  Three-Interval  Assumption 

To  test  the  assumption  underlying  the  three-interval  isotropic  prediction,  the  following 
experiment  was  conducted.  The  stimuli  were  the  same  as  those  used  in  the  misaligned-dot 
experiment  except  that  the  separation  between  the  two  dots,  y,  was  fixed  at  100  arcmin.  The 
orthogonal  position  of  the  lower  dot  was  random  over  the  same  range  as  in  the  previous 
experiment.  However,  in  this  experiment,  the  lateral  position  of  the  lower  dot  was  recorded,  and 
the  lower  dot  was  constrained  to  appear  in  each  of  six  equal  intervals  (three  right  and  three  left  of 
center)  during  each  block  of  trials.  (There  was  no  end-of-block  signal  to  the  observer,  and  21 
blocks  were  presented  sequentially,  so  the  restrictions  inherent  in  the  block  design  provided,  at 
most,  weak  cues  to  the  observer.)  The  observer’s  task  was  to  assign  each  stimulus  to  one  of  three 
intervals:  lower  dot  in  the  center  third  of  the  horizontal  range,  lower  dot  far  to  the  right  or  left,  or 
lower  dot  between  those  two  extremes.  No  trial-to-trial  feedback  was  given.  The  observer  had  one 
practice  session  (21  blocks  of  6  trials  each)  in  which  he  learned  the  range  of  displacements  that 
would  be  presented  In  subsequent  sessions,  21  blocks  of  6  trials  were  again  presented;  the  first 
block  was  discarded,  as  is  the  custom  in  our  laboratory.  Five  or  more  such  data  sessions  were 

conducted  for  each  observer  at  each  of  four  orientations:  0°,  15°,  30°,  and  45°.  Figure  9  shows 
the  percentage  of  correct  assignments  for  each  orientation  for  two  observers.  Both  observers 
assigned  the  lower  dot  into  one  of  three  intervals  on  the  basis  of  its  orthogonal  displacement  with  a 
high  degree  of  accuracy  that  was  independent  of  the  orientation  of  the  measurement  axis. 

Therefore,  the  three-interval  isotropic  model  is  a  plausible  explanation  of  the  data  obtained  with  the 
misaligned-dots. 


Percent  Correct 
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Fig.  9  Percent  correct  assignment  of  orthogonal  position  of  lower  dot  to  one  of  three  intervals:  center,  far  left 
or  right,  and  intermediate  left  or  right.  Observer  RLW,  open  squares;  Observer  LMT,  filled  squares. 
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V.  Summary 

Unlike  contrast  detection  and  orientation  discrimination,  large-scale  localization  appears  to 
exhibit  no  orientation  selectivity.  The  isotropic  nature  of  this  process  was  indicated  in  three  ways: 

•  The  lack  of  reproducible  variation  in  localization  thresholds  with  the  orientation  of 
the  stimulus  axis, 

•  The  lack  of  variation  in  the  localization  thresholds  with  the  orientation  of  the 
projected  measurement  axis  for  misaligned  stimuli, 

•  The  ability  of  a  (plausible)  isotropic  model  to  account  for  the  data  obtained  in  a  task 
that  specifically  elicited  an  oriented  localization  judgment 

We  conclude  that  the  localization  process  is  probably  not  selective  for  orientation.  This 
conclusion  supports  the  idea  that  localization  cannot,  in  general,  be  accounted  for  at  a 
frequency-channels  stage  of  processing,  which  is  sensitive  to  orientation.  Instead,  it  seems  likely 
that  localization  occurs  at  a  subsequent  stage  that  is  less  sensitive  to  the  exact  details  of  the  original 
retinal  image. 

VI.  Acknowledgments 

This  research  was  sponsored  by  the  Air  Force  Office  of  Scientific  Research,  Air  Force 
Systems  Command,  USAF,  under  contract  number  AFOSR  F49620-85-K-0022.  The  United 
States  Government  is  authorized  to  reproduce  and  distribute  reprints  for  Governmental  purposes 
notwithstanding  any  copyright  notation  thereon. 


No  Orientation  Selectivity  in  Large-Scale  Localization 
C.  A.  Burbeck 


REFERENCES 

1.  G.  Westheimer,  "Visual  hyperacuity,"  Progress  in  Sensory  Physiology,  1,  Springer, 

Berlin  (1981). 

2.  R.  J.  Watt  and  M.  J.  Morgan,  "Spatial  filters  and  the  localization  of  luminance  changes  in 

human  vision,"  Vision  Res.  24, 1387-1397  (1984). 

3.  S.  A.  Klein  and  D.  M.  Levi,  "Hyperacuity  thresholds  of  1  sec:  theoretical  predictions  and 

empirical  validation,"  J.  Opt.  Soc.  Am.  A  2,  1 170-1190  (1985). 

4.  J.  Hirsch  and  R.  Hylton,  "Limits  of  spatial  frequency  discrimination  as  evidence  of  neural 

interpolation,"  J.  Opt.  Soc.  Am.  72,  1367-1374  (1982). 

5.  G.  Westheimer  and  S.  P.  McKee,  "Spatial  configurations  for  visual  hyperacuity,"  Vision 

Res.  17,941-947(1977). 

6.  S.  A.  Klein  and  D.  M.  Levi,  "Position  sense  in  the  peripheral  retina,"  J.  Opt  Soc.  Am.  A 
4,  1543-1553  (1987). 

7.  C.  A.  Burbeck,  "Exposure-duration  effects  in  localization  judgments,"  J.  Opt.  Soc.  Am.  A 

3,  1983-1988  (1986). 

8.  C.  A.  Burbeck,  "Position  and  spatial  frequency  in  large-scale  localization  judgments," 

Vision  Res.  3,  417-428  (1987). 

9.  A.  Toet,  M.  P.  van  Eekhout,  H.  L.  J.  J.  Simons  and  J.  J.  Koenderink,  "Scale  invariant 

features  of  spatial  displacement  discrimination,"  Vision  Res.  3, 441-452  (1987). 


10.  R.  L.  DeValois  and  K.  K.  DeValois,  "Spatial  Vision,"  Ann.  Rev.  Psychol.  31,  309-341 
(1980). 


No  Orientation  Selectivity  in  Large-Scale  Localization 
C.  A.  Burbeck 


11.  T.  Caelli,  H.  Brettel,  I.  Rentschler  and  R.  Hilz,  "Discrimination  thresholds  in  the 

two-dimensional  spatial  frequency  domain,"  Vision  Res.  23,  129-133  (1983). 

12.  F.  W.  Campbell,  J.  J.  Kulikowski  and  J.  Levinson,  "The  effect  of  orientation  on  the  visual 

resolution  of  gratings,"  J.  Physiol.  187, 427-436  (1966). 

Probit  Analysis  (Cambridge  Univers: 


13.  D.  J.  Finney, 


Press,  Cambridge,  1977). 


No  Orientation  Selectivity  in  Large-Scale  Localization 
C.  A.  Burbeck 


Appendix  A 

Calculation  of  Probabilistic  Feedback 

The  percentage  of  time  that  "closer"  was  the  correct  response  for  a  given  value  of  s  is  most 
easily  calculated  in  terms  of  the  angles  subtended  by  the  arcs.  Figure  A- 1  shows  the  terminology 
used  in  the  following  calculations.  For  pictorial  clarity  the  separation  and  the  angles  are  not  to 
scale. 

Five  conditions  can  obtain,  as  indicated  by  the  five  arcs.  For  arc  1,  "closer”  is  always  the 
correct  response;  for  arc  5,  "farther"  is  correct.  For  the  rest,  feedback  is  probabilistic.  The  most 
general  case  is  given  by  arc  3. 

0Q  is  one  half  of  the  full  range  of  the  arc.  (Half-angles  are  used  for  computational 
simplicity.)  02  is  (one  half  of)  the  section  of  arc  that  is  outside  of  the  stimulus  range.  Thus  0q-92 
represents  the  range  of  possible  stimuli  at  separation  s.  0j  is  determined  by  the  vertical  and  by  the 

intersection  of  the  arc  with  the  y=100  line.  Thus  0o-0j  represents  the  range  of  possible  stimuli  for 

which  the  correct  response  is  "closer".  The  probability  that  "closer"  is  correct  for  a  given  value  of 
is  then  given  by 


vei 


0O  -  ®2 


where  0Q,  0j,  and  02  are  functions  of  s,  as  described  below. 


If  s  <  (ymin2+xmin2)1'2  (arcs  1,  2  and  3  in  Fig.  A-l),  then  0Q  is  determined  by  the  intersection 
of  the  arc  with  y^.  Thus 


^min 

0n  =  arccos  -  for  s  <  (ymi  2+xmi 2)1/2. 
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Under  our  conditions,  (ymin2+’tnun2)1/2  =  125.6. 

If  s  >  (ymin2+Jtmin2)1/2  (arcs  4  and  5)>  then  and  Xmax  determine  the  end  points  of  the  arc 
Thus 

xmin 

0o=  arcsin  -  fors  >  )m. 

s 

For  all  s,  100 

=  arccos  -  . 

s 

However,  02  depends  on  the  value  of  s: 

©2  =  0  for  s  <  ymax ,  (arcs  1  and  2) 

and  ymax 

07  =  arccos  -  for  s  >  y  (arcs  3,  4  and  5). 
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Appendix  B 

Calculation  of  Simple  Prediction 
of  Percent  "Closer" 

Because  linear  interpolation  was  used  to  complete  the  psychometric  function  for  the  aligned 
condition,  the  rotated  function  was  easy  to  integrate.  For  each  segment  of  the  rotated  function,  the 
integral  was: 

i+i(y> 

Ri(y)  =  J  (x2  +  y2)1/2  dx  (l) 

^(y) 

where  aj(y)  and  aj+1(y)  are  the  values  of  x  over  which  a  given  rotated  line  segment  is  to  be 

integrated.  These  endpoints  vary  with  the  value  of  y  and  are  calculated  as  follows.  Let  ej , 
i=0,..,15  be  the  endpoints  of  the  line  segments  that  collectively  constitute  the  psychometric  function 
for  the  aligned  condition.  Then  for  each  value  of  y,  a^y)  =  (y2  -  ei2)1/2. 

The  integral,  (1),  can  be  solved  analytically.  For  each  interval,  i,  the  integral  is: 


*-a»+i(y) 

R,  (y)=  (ntij/2)  {x(x2+y2)1/2  +  y2log  I  x  +  (x2+y2)I/2  I  }  | 

where  m^  is  the  slope  of  the  line  segment  for  that  interval,  and  y  is  Fixed.  The  average  percent 
"closer"  for  this  segment  of  the  integral,  weighted  by  the  length  of  the  interval  (aj(y),  aI+1  (y)),  is 


S,(y)  =  Rj  (y)+  intercept,  *  [a^Cy)  -a^y)]  . 
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The  average  percent  "closer"  for  a  given  value  of  y  is  then 

SCy)  - 1 2S,(y)  /  <WW 
i 

(For  simplicity,  the  calculations  were  all  done  on  the  basis  of  one  half  of  the  symmetric  rotated 
function,  hence  the  factor  of  2.) 

S(y)  was  calculated  for  y  values  ranging  from  89  to  109.  To  obtain  the  predicted 
psychometric  function  from  these  values,  I  converted  S(y)  to  average  percent  correct  by  subtracting 
S(y)  from  100  for  y<100  and  then  averaging  these  predicted  percent  corrects  across  constant  values 

of  Ay,  where  Ay  =  1 100-y  | .  These  are  the  values  plotted  in  Fig.  7. 
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Abstract  -  Several  effects  of  pattern  adaptation  are  examined  and  compared  in  this  study  of  the 
relationship  between  a  spatial  frequency  channels  representation  and  higher  levels  of  spatial 
processing.  Specifically,  we  conducted  experiments  to  determine  whether  the  various  pattern 
adaptation  effects  are  tied  to  the  retinal  spatial  frequencies  of  gratings  or  to  their  object  spatial 
frequencies.  The  results  of  these  experiments  (1)  verify  a  previous  finding  that  contrast-threshold 
elevation  is  tied  to  the  retinal,  not  object,  spatial  frequency  of  the  adapting  and  test  gratings 
(Blakemore,  etal.,  1972),  (2)  fail  to  replicate  the  finding  (Regan  and  Beverley,  1983)  that 
frequency-discrimination  thresholds  are  elevated  by  pattern  adaptation,  and  (3)  show  that  the 
perceived  spatial  frequency  shift  (PSFS)  is  also  tied  to  retinal  spatial  frequencies,  despite  evidence 
that  contrast-threshold  elevation  and  the  PSFS  occur  at  different  sites  (Klein,  et  al .,  1 974).  The 
PSFS  implies  that  frequency  discrimination  thresholds  should  be  altered  by  pattern  adaptation,  but 
not  in  the  way  reported  in  the  literature.  The  magnitude  of  this  implied  threshold  change  is 
calculated  and  compared  to  the  experimental  findings.  Collectively  the  results  support  the  idea  that 
a  spatial  frequency  channels  for  analogous  stage  of  processing  as  revealed  in  classical  pattern 
adaption  effects,  is  fundamental  to  higher  levels  of  spatial  representation. 


Keywords:  Pattern  adaptation,  spatial  frequency  discrimination,  contrast  detection,  perceived 
spatial  frequency  shift. 
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INTRODUCTION 

Recent  research  in  spatial  vision  has  been  dominated  by  the  idea  that  the  early  stages  of 
spatial  vision  can  be  accurately  modeled  as  a  set  of  filters  that  are  selectively  sensitive  to  a  limited 
range  of  spatial  frequencies  (DeValois  and  DeValois,  1980;  Kelly  and  Burbeck,  1984).  Although 
the  original  spatial  frequency  channels  concept  has  been  modified  to  reflect  the  spatially  localized 
nature  of  early  spatial  processing  (refs),  the  basic  concept  of  multiple  spatial-frequency-selective 
mechanisms  remains  a  dominant  theme.  With  this  basic  theoretical  foundation,  two  major  research 
questions  at  this  time  are: 

•  Which  perceptual  phenomena  can  be  accounted  for  by  a  spatial  frequency  channels 
approach,  and  which  require  that  we  postulate  subsequent  or  alternative  types  of 
spatial  processing? 

•  What  is  the  relationship  between  the  spatial  frequency  channels  representation 
(assuming  one  exists)  and  these  other  spatial  processes?  In  particular,  is  there 
evidence  for  a  serial  relationship,  as  suggested  by  the  idea  that  channels  model  the 
processing  that  occurs  in  layer  V4  of  visual  cortex,  or  is  parallel  processing  suggested 

In  the  research  reported  here,  we  examine  the  relationships  between  the  detectability  and 
the  discriminability  of  spatial  frequency  gratings.  We  use  pattern  adaptation  effects  as  probes, 
seeking  to  determine  1 )  the  sites  of  the  various  pattern  adaptation  effects  and  2)  the  relationship 
between  those  pattern  adaptation  effects  and  the  perceived  spatial  frequency  and  discriminability  of 
gratings. 

l  or  many  years  now  spatial  frequency  discrimination  has  been  modeled  using  a  spatial 
frequency  channels  approach:  'Thomas  and  his  colleagues  model  the  ability  in  terms  of  a  metric  on 
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the  space  of  spatial  frequency  channel  responses,  and  Regan  and  Beverley  postulate  that  the  ratios 
of  frequency  channel  responses  is  the  relevant  quantity.  Thomas'  model  is  based  on  a  comparison 
of  the  detectability  and  discriminability  of  gratings,  whereas  Regan's  theory  is  based  on  the  results 
of  his  study  of  the  effects  of  pattern  adaptation  on  spatial  frequency  discrimination  thresholds. 
Both  theories  assume  that  detection  and  frequency  discrimination  are  based  on  a  common  neural 
representation. 

However,  evidence  against  that  assumption  is  mounting.  The  first  argument  against  this 
assumption  that  I  have  seen  was  in  a  paper  by  Klein  et  al.  in  1974.  They  found  that  the  perceived 
spatial  frequency  shift  (PSFS)  has  the  same  properties  whether  it  results  from  prior  exposure  to  an 
adapting  grating  or  from  simultaneous  exposure  to  a  surrounding  "adapting"  grating,  whereas  the 
contrast-threshold  elevation  effect  occurs  only  after  prior  exposure  to  an  adapting  grating.  A 
surrounding  "adapting"  grating  has  no  effect  on  the  detection  threshold.  These  results  raise  the 
possibility  not  only  that  detection  and  discrimination  are  dissociated  as  Klein  et  al.  concluded,  but 
also  that  there  are  two  sites  of  pattern  adaptation,  one  that  affects  contrast  thresholds  and  one  that 
affects  perceived  spatial  frequency. 

The  idea  that  detection  and  discrimination  are  based  on  different  representations  is  also 
supported  by  a  recent  study  by  Gorea  (1987).  He  studied  the  effects  of  backward  masking  on 
identification  and  detection  of  sinewave  gratings  and  found  that  the  ratio  of  detection  to 
identification  is  a  U-shaped  function  of  SOA  (stimulus-onset-asynchrony).  He  argued  from  this 
that  detection  and  discrimination  are  serial  processes. 

I  have  also  suggested  that  there  is  a  serial  relationship  between  these  two  processes 
(Burbeck,  1987).  Specifically,  I  found  that  frequency  discrimination  is  not  done  on  the  basis  of 
retinal  spatial  frequencies  at  all,  but  instead  is  done  on  the  basis  of  a  higher  level  representation  in 
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which  information  about  the  distances  to  the  gratings  is  included  to  achieve  estimates  of  the  actual 
properties  of  the  objects  (Burbeck,  1987).  In  short,  observers  compare  the  perceived  spatial 
frequencies  and  not  the  retinal  spatial  frequencies  of  the  gratings.  Contrast  detection  thresholds,  on 
the  other  hand,  appear  to  be  determined  solely  by  the  retinal  spatial  frequencies  of  the  gratings, 
independently  of  their  perceived  spatial  frequencies.  For  brevity,  I  will  refer  to  the  stage  in  which 
perceived  spatial  frequencies  are  represented  as  the  "object  spatial  frequency  representation",  but 
this  name  does  not  imply  any  assumptions  about  the  manner  in  which  information  about  object 
properties  is  stored.  The  name  was  chosen  to  parallel  the  term  spatial  frequency  channels 
representation,  that  is  used  to  describe  the  more  distal  stages  of  processing  in  which  local  retinal 
spatial  frequencies  are  represented. 

In  the  present  study,  I  use  pattern  adaption  paradigms  to  pursue  the  question  of  the  seriality 
of  a  retinal  spatial  frequency  channels  representation,  which  can  account  for  some  detection 
thresholds,  and  an  object  spatial  frequency  representation,  which  is  required  to  account  for 
discrimination  thresholds.  If  the  effects  of  pattern  adaptation  on  perceived  frequency  occur  at  a 
retinal  spatial  frequency  channels  (or  analogous)  stage  then  the  seriality  of  the  two  stages  is 
supported.  On  the  other  hand,  if  the  effects  of  pattern  adaptation  on  perceived  frequency  are  tied  to 
the  object  spatial  frequencies,  i.e.  to  the  site  of  discrimination,  then  the  seriality  of  these  two  stages 
is  neither  supported  nor  rejected.  In  the  experiments  described  below,  we  determine  the  sites  of 
several  pattern  adaptation  effects  to  see  if  they  occur  at  the  retinal  spatial  frequency  channels  stage 
or  at  the  more  proximal  stage  in  which  object  spatial  frequencies  are  estimated. 

The  research  by  Klein  et  al.  (1974)  suggests  that  the  PSFS  might  occur  at  a  stage  that  is 
proximal  to  the  frequency  channels  stage,  and  that  idea  is  lent  credence  by  the  fact  that  perceived 
spatial  frequencies  are  estimates  of  object,  not  retinal,  spatial  frequencies.  Also  providing  indirect 
support  for  the  idea  that  some  pattern  adaptation  effects  might  occur  in  an  object-spatial-frequency 
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representation  are  Regan  and  Beverley's  data  on  the  effects  of  pattern  adaptation  on  frequency 
discrimination.  They  found  that  frequency  discrimination  thresholds  are  most  elevated  when  the 
test  frequency  is  2.5  times  the  adapting  frequency.  This  is  significant  because  the  diameter  of  their 
adapting  stimulus  was  2.5  times  that  of  their  test  stimuli.  Thus,  the  maximum  effect  occurred  when 
the  number  of  cycles  in  the  test  and  adapting  stimuli  was  the  same.  In  their  experiment,  observers 
viewed  the  stimuli  monocularly  in  a  dark  room,  so  they  might  well  have  perceived  the  adapting 
stimulus  as  having  the  same  physical  (object)  diameter  as  the  test  stimulus,  only  seen  at  a  shorter 
viewing  distance.  If  this  percept  were  dominant,  then  the  maximum  effect  occurred  when  the 
perceived  spatial  frequencies  of  the  adapting  and  test  gratings  were  equal.  Thus,  there  are  some 
suggestions  in  the  literature  that  pattern  adaptation  effects  do  not  all  occur  in  a  common 
retinal-spatial-frequency-based  representation  of  the  stimulus. 

To  test  this  intriguing  possibility,  and  to  investigate  further  the  relationship  between  the 
postulated  retinal  spatial  fequency  representation  and  object  spatial  frequency  representation,  we 
conducted  several  experiments  in  which  we  manipulated  the  perceived  spatial  frequencies  and  the 
retinal  spatial  frequencies  of  the  gratings  independently.  If  two  gratings  are  presented  at  a  single 
viewing  distance,  as  is  normally  used,  then  the  relationship  between  their  perceived  spatial 
frequencies  is  the  same  as  that  between  their  retinal  spatial  frequencies.  However,  if  the  gratings 
are  presented  at  different  viewing  distances  and  depth  information  is  available  to  the  observer,  that 
connection  is  broken.  We  can  then  determine  whether  the  pattern  adaptation  effect  is  occurring  at  a 
stage  of  processing  in  which  the  retinal  spatial  frequencies  are  represented,  or  at  a  stage  of 
processing  in  which  the  object  spatial  frequencies  are  represented,  e.g.,  at  the  site  of  spatial 
frequency  discrimination.  This  is  the  basis  of  the  experiments  described  below. 
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CONTRAST-THRESHOLD  ELEVATION 

This  experiment  lays  some  groundwork  by  confirming  that  the 
contrast-threshold-elevation  pattern-adaptation  effect  is  maximum  when  the  retinal  spatial  frequency 
of  the  test  grating  matches  that  of  the  adapting  grating,  not  when  their  perceived  spatial  frequencies 
match.  It  replicates  an  experiment  performed  by  Blakemore  et  al.  in  1972.  Observers  adapted  to  a 
high-contrast  grating  that  was  presented  either  at  the  same  viewing  distance  as  the  test  stimuli,  or  at 
a  closer  viewing  distance.  The  retinal  spatial  frequency  of  the  adapting  grating  was  fixed. 

However,  it  appeared  to  have  a  much  higher  spatial  frequency  when  it  was  closer  to  the  observer 
than  when  it  was  farther  away.  This  is  because  the  object  frequency  (cycles/cm  in  the  stimulus 
plane)  is  higher  when  it  is  closer,  and  the  perceived  frequency  estimates  the  object  frequency, 
consistent  with  size  constancy.  If  the  contrast-threshold  elevation  effect  is  tied  to  the  perceived 
spatial  frequencies,  it  should  peak  at  different  retinal  spatial  frequencies  for  the  two  conditions. 

Methods 

The  stimuli  were  displayed  on  CRT  monitors  (Conrac  C2400,  5 1 2x5 12,60  l  Iz, 
noninterlaced  ),  with  mean  luminance  of  78  cd/m2.  The  room  was  dimly  lit  (approximately  3 
cd/nri),  and  viewing  was  binocular  to  facilitate  acquisition  of  depth  information.  A  headrest  was 
used  to  keep  the  viewing  distance  constant.  The  stimuli  were  all  horizontal  sine  wave  gratings. 

The  adapting  grating  had  a  contrast  of  80%  and  was  flickered  in  counterphase  at  2  1  Iz  to  prevent  the 
formation  of  negative  afterimages  (Burbeck,  1986).  The  initial  adaptation  period  was  1  min  and  the 
intertrial  adaptation  periods  were  15  sec.  The  adapting  grating  was  presented  on  one  monitor,  the 
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test  gratings  on  another.  The  two  monitors  were  placed  so  that  the  observer  perceived  them  as 
juxtaposed.  The  observer  simply  shifted  his  gaze  between  them  at  the  beginning  and  end  of  each 
test  interval. 

There  were  two  experimental  conditions  in  these  contrast  detection  experiments.  In  the 
equidistant  condition,  the  test  and  adapting  gratings  were  both  presented  3  meters  from  the 
observer.  In  the  nonequidistant  condition,  the  test  and  adapting  gratings  were  presented  at  different 
distances:  the  adapting  grating  was  at  1  meter,  and  the  test  was  at  3  meters.  At  1  m,  the  gratings 
subtended  21x15  deg;  at  3  m,  they  subtended  7.8x5.5  deg.  The  retinal  spatial  frequency  of  the 
adapting  grating  was  4  c/deg  in  both  the  equidistant  condition  and  the  nonequidistant  condition. 
However,  the  perceived  spatial  frequencies  of  the  adapting  gratings  in  the  two  conditions  differed 
by  approximately  a  factor  of  three,  because  their  viewing  distances  differed  by  a  factor  of  three. 

The  spatial  frequency  of  the  test  grating  was  varied  to  determine  the  spatial  frequency  at 
which  the  peak  adaptation  effect  occurred.  The  test  grating  was  presented  for  500  msec  with  an 
abrupt  onset  and  termination.  Detection  thresholds  were  measured  by  a  yes/no  staircase  procedure 
(increment  factor  1.1),  with  two  interleaved  staircases  (Comsweet,  1962).  At  least  ten  contrast 
reversals  were  used  to  estimate  each  threshold.  In  the  sessions  without  adaptation,  the  same 
procedures  were  used,  but  the  adapting  stimulus  was  a  uniform  field  of  the  same  mean  luminance 
as  the  other  stimuli.  Contrast-threshold  elevation  ratios  were  calculated  by  dividing  the  contrast 
threshold  obtained  after  adaptation  to  the  grating  by  the  contrast  threshold  obtained  after  adaptation 
to  the  uniform  field. 

Results 

Figure  1  shows  the  contrast-threshold-elevation  ratios  for  the  equidistant  condition  (open 
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symbols),  and  for  the  nonequidistant  condition  (filled  symbols),  plotted  as  a  function  of  the  retinal 
spatial  frequency  of  the  test  grating.  The  solid  arrows  show  the  retinal  spatial  frequency  of  the 
adapting  grating.  The  shaded  arrows  show  the  spatial  frequency  at  which  the  test  and  adapting 
gratings  have  the  same  perceived  spatial  frequency  in  the  nonequidistant  condition. 

The  contrast  threshold  is  elevated  at  4  c/de g  regardless  of  the  relationship  between  the 
perceived  frequencies  of  the  test  and  adapting  gratings.  If  this  pattern  adaptation  effect  were  tied  to 
the  perceived  spatial  frequencies  of  the  stimuli,  then  presenting  the  adapting  grating  at  1  meter 
instead  of  3  meters  should  have  shifted  the  peak  effect  to  approximately  1.3  c/deg,  where  the 
perceived  spatial  frequencies  of  the  test  and  adapting  gratings  match.  However,  in  agreement  with 
the  previous  finding  of  Blakemore  et  al.  (1972),  we  find  that  threshold  is  elevated  most  when  the 
retinal  spatial  frequencies  of  the  adapting  and  test  gratings  are  equal,  independent  of  any  differences 
in  their  perceived  spatial  frequencies.  Thus,  the  contrast-threshold  elevation  effect  occurs  at  a  stage 
of  processing  in  which  retinal  spatial  frequencies  are  represented. 


Spatial  Frequency  (cycles/degree) 
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Figure  1.  Threshold  elevation  ratios  for  detecting  a  grating  at  3  meters  following  adaptation  to  a  high-contrast 
grating  of  4  c/deg.  Adapting  grating  at  1  meter  (filled  squares)  or  at  3  meters  (open  squares).  The  solid  arrows 
indicate  the  retinal  spatial  frequency  of  the  adapting  grating.  The  shaded  arrows  show  the  spatial  frequency  of  the  test 
grating  at  which  the  perceived  frequencies  of  the  test  and  adapting  gratings  in  the  nonequidistant  condition  match. 
Two  observers. 


FREQUENCY-DISCRIMINATION-THRESHOLD  ELEVATION 


As  noted  in  the  Introduction,  the  findings  of  Regan  and  Beverley  (1983),  Klein  et  al. 
(1974),  and  Burbeck  (1987)  combine  to  suggest  that  one  form  of  grating  adaptation  might  occur  at  a 
stage  of  processing  in  which  perceived  spatial  frequency  is  represented.  Pursuing  this  possibility, 
we  attempted  to  replicate  Regan  and  Beverley's  finding  that  pattern  adaptation  elevates 
frequency-discrimination  thresholds,  with  the  peak  effect  occurring  at  2.5  times  the  adapting 
frequency.  The  original  goal  of  this  experiment  was  to  determine  whether  the 
frequency-discrimination  adaptation  result  was  tied  to  the  retinal  or  to  the  perceived  spatial 
frequencies  of  the  test  and  adapting  gratings.  However,  repeated  attempts  to  replicate  their  findings 
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Methods 

Several  conditions  were  tried;  the  results  were  the  same  in  each.  Data  from  two  conditions 
are  shown.  The  data  shown  in  Fig.  2  were  collected  under  the  following  conditions. 

Figure  2  conditions: 

Observers  viewed  the  stimuli  monocularly  at  a  distance  of  1  meter  in  an  otherwise  dark 
room.  The  test  and  adapting  stimuli  appeared  sequentially  at  the  same  location  so  that  no  saccade 
was  required  between  the  adapting  and  test  intervals.  (A  beam  splitter  and  two  computer-controlled 
shutters  were  used  to  superimpose  the  positions  of  the  test  and  adapting  stimuli.)  Test  stimulus 
diameter  was  13.3  deg,  and  adapting  stimulus  diameter  was  5.3  deg  (larger  than  Regan  and 
Beverley's  stimuli,  but  with  the  same  2.5:1  ratio  of  adapting  to  test  diameter).  All  stimuli  were 
horizontal  sine-wave  gratings,  as  in  the  previous  experiment.  The  mean  luminance  of  the  test  was 
17  cd/m2,  and  of  the  adapting  stimulus,  78  cd/m2.  (The  test  and  adapting  luminances  were  chosen 
to  replicate  Regan  and  Beverley's  conditions.)  Adapting  contrast  was  80%.  The  test  contr  ast  was 
random  in  the  range  40-60%  to  prevent  perceived  contrast,  which  varies  with  spatial  frequency, 
from  being  used  as  a  cue  to  frequency.  The  phases  of  the  test  gratings  were  varied  randomly  in  the 
range  0  to  180  deg  relative  to  the  edge  of  the  display. 

The  adapting  stimuli  were  counterphase-flickered  at  2  Hz.  The  initial  adapting  duration  was 
3  min.  The  intertrial  adaptation  interval  was  25  sec.  At  the  end  of  each  adapting  interval,  the 
observer  initiated  the  test  interval  by  pressing  a  button.  The  test  gratings,  which  were  not  flickered, 
were  each  presented  for  250  msec  with  abrupt  onsets  and  terminations.  The  time  between 
presentations  of  the  two  test  gratings  in  a  trial  was  1 .2  sec.  The  observer's  task  was  to  indicate 
which  grating  had  the  higher  spatial  frequency.  Auditory  right/wrong  feedback  was  given  after 
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each  trial.  Aftei  the  observer's  response,  the  adapting  grating  would  reappear.  In  the  control  runs, 
the  conditions  were  identical  except  that  the  adapting  stimulus  was  uniform. 

The  method  of  constant  stimuli  was  used,  and  at  least  210  trials  contributed  to  each 
psychometric  function.  The  frequencies  of  the  test  gratings  presented  on  a  given  trial  differed  by 
1%  to  7%.  The  average  test  frequency  was  5.9  c/deg.  The  relationship  between  the  test  and 
adapting  frequencies  was  varied  by  changing  the  adapting  frequency.  The  adapting  frequencies 
were:  5.9  c/deg  (test=adapt),  2.9  c/deg  (test=2x  adapt),  2.35  c/deg  (test=2.5x  adapt),  and  1 .9 
c/deg  (test=3x  adapt).  The  data  for  the  unadapted,  the  test=adapt,  and  the  test=2.5x  adapt 
conditions  were  collected  in  interleaved  sessions,  with  an  unadapted  session  before  each  adapted 
session.  Data  for  the  other  conditions  were  collected  later  under  slightly  different  conditions,  as 
described  below. 

Figure  3  conditions: 

The  data  in  Fig.  3  were  collected  under  conditions  that  are  similar  to  those  used  for  the  data 
in  Fig.  2,  with  some  slight  modifications  to  replicate  Regan  and  Beverley's  conditions  more 
exactly.  The  viewing  distance  was  145  cm;  the  test  screen  was  3.5  deg  in  diameter  and  the 
adapting  screen  was  9  deg  in  diameter.  The  contrast  of  the  adapting  grating  was  100%.  The 
gratings  were  counterphase  flickered  at  1.5  Hz.  Initial  adaptation  was  5  min  with  subsequent 
intertrial  adapting  intervals  of  10  sec.  Test  gratings  were  presented  with  the  same  temporal 
envelope  as  that  used  by  Regan  and  Beverley  (1983,  see  their  Fig.  1 ).  All  of  these  changes  were 
made  to  make  our  conditions  more  like  theirs.  Two  adapting  frequencies  were  tested  under  these 
conditions:  test  =  2x  adapt,  and  test  =  3x  adapt. 
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Results 


Typical  pre-  and  postadaptation  psychometric  functions  for  frequency  discrimination 
obtained  under  our  initial  conditions  are  shown  in  Fig.  2.  There  is  no  evidence  of  elevation  in 
either  of  the  conditions.  If  anything,  the  frequency  discrimination  threshold  is  lower  following 
adaptation  -  i.e.  the  psychometric  function  is  higher.  Figure  3  shows  data  obtained  with  the 
modifications  described  above  that  made  our  conditions  as  similar  to  those  of  Regan  and  Beverley 
as  we  could  achieve.  These  data  also  show  that  adaptation  does  not  elevate  frequency 
discrimination  thresholds  at  frequencies  2  to  3  times  the  test  frequency  for  this  naive  observer. 

Two  other  observers  were  also  tested  in  the  test  =  2.5x  adapt  condition,  and  no  threshold-elevation 
effects  were  found. 

A)  Test  Frequency  =  Adapting  Frequency 
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B)  Test  Frequency  =  2.5x  Adapting  Frequency 


Figure  2.  Psychometric  functions  for  frequency  discrimination  at  5  9  c  deg.  measured  after  adaptation  to  a  uniform 
tield  (open  squares)  and  alter  adaptation  to  a  flickering  grating  (tilled  squares)  (A)  Adapting  frequency,  5.9  c  deg.  ( B) 
Adapting  frequency,  2  35  c  deg 

A)  Test  Frequency  =  2x  Adapting  Frequency 
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B)  Test  Frequency  =  3x  Adapting  Frequency 


Af/f  (%) 

Figure  3.  Same  as  Figure  2  except  that  details  of  adaptation  and  test  presentation  differed  slightly.  See  text.  (A) 
Adapting  frequency,  2.9  c/deg.  (B)  Adapting  frequency  1.9  cy/deg. 
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PERCEIVED  SPATIAL  FREQUENCY  SHUT 
FOLLOWING  PATTERN  ADAPTATION 

Failing  to  reproduce  the  frequency-discrimination  threshold-elevation  effect,  we  turned  to 
the  perceived  spatial  frequency  shift,  which  has  been  replicated  repeatedly  (Blakemore  and  Sutton, 
1969;  Blakemore  et  al.,  1970;  Klein  et  al.,  1974).  The  suggestion  that  the  PSFS  is  a  fundamentally 
different  type  of  pattern  adaptation  effect  than  contrast-threshold  elevation  (Klein  et  al.,  1974) 
raises  the  possibility  that  the  PSFS  might  be  tied,  not  to  the  retinal  spatial  frequencies  of  the  stimuli, 
but  to  their  perceived  frequencies  instead.  To  investigate  this  possibility,  we  measured  the  PSFS 
with  the  test  and  adapting  gratings  at  different  viewing  distances,  using  an  experimental  design  that 
was  similar  to  that  used  in  the  previous  experiments. 

Methods 

In  this  experiment,  the  adapting  grating  was  restricted  to  the  upper  half  of  a  21x15  deg 
bipartite  field.  Viewing  distance  was  1  m.  During  the  adapting  intervals,  the  lower  hemifield  was 
always  uniform  at  the  mean  luminance  of  the  other  stimuli.  A  small  bar  was  presented  in  the 
middle  of  the  display,  which  the  observers  were  instructed  to  fixate.  The  initial  adaptation  interval 
was  1  min  and  the  intertrial  adaptation  intervals  were  15  sec. 

The  test  stimuli  were  presented  on  a  10  x  8  deg  bipartite  field  with  a  central  fixation  bar. 
Viewing  distance  was  2  m.  During  the  test  interval,  two  gratings  were  presented  simultaneously, 
one  in  each  hemifield.  They  were  presented  for  225  msec  to  reduce  the  likelihood  that  the  observer 
would  inadvertently  make  a  large  saccade  during  the  test  interval.  The  displays  appeared 
juxtaposed,  as  in  the  pattern-adaptation  experiment,  and  the  trials  were  timed  so  that  the  observers 
could  saccade  from  the  adapting  field  to  the  test  field  and  fixate  the  central  bar  before  the  test  stimuli 
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were  presented.  The  duration  of  this  interval  between  presentation  of  the  adapting  and  test  stimuli 
was  1.2  sec.  The  contrasts  of  the  test  gratings  in  the  two  hemifields  were  varied  randomly  and 
independently  in  the  range  40  to  60%,  to  prevent  perceived  contrast  from  being  used  as  a  cue  to 
frequency.  The  phases  of  the  gratings  were  also  varied  randomly  and  independently  in  the  two 
hemifields  (over  the  range  0  to  180  deg).  The  spatial  frequencies  of  the  two  test  gratings  differed 
by  2,  4,  6,  8,  10,  12,  or  14  %.  The  average  spatial  frequency  of  the  two  test  gratings  was  2.6 
c/deg.  The  observers'  task  was  to  report  whether  the  upper  or  lower  hemifield  appeared  to  have  the 
grating  of  higher  spatial  frequency.  No  feedback  was  given.  Experiments  were  conducted  with 
adaptation  to  a  uniform  field  (unadapted  condition)  and  with  adaptation  to  a  stimulus  in  which  the 
upper  hemifield  contained  a  flickering  grating  and  the  lower  hemifield  was  uniform  (adapted 
condition).  The  mean  luminance  of  both  hemifields  was  constant  throughout  the  experiment,  and 
the  central  fixation  bar  was  always  present. 

One  could  determine  whether  the  PSFS  is  tied  to  the  retinal  or  perceived  spatial  frequencies 
by  conducting  a  complete  PSFS  study  with  the  test  and  adapting  gratings  at  different  viewing 
distances.  However,  a  judicious  choice  of  test  and  adapting  frequencies  made  the  complete  study 
unnecessary.  By  using  an  adapting/test  pair  in  which  the  adapting  grating  had  a  lower  retinal 
spatial  frequency  but  a  higher  perceived  frequency  than  the  test  grating,  we  could  distinguish 
between  the  two  possibilities  in  a  single  experiment. 

The  rationale  for  the  choice  of  stimuli  can  be  explained  most  easily  by  reference  to  a  typical 
PSFS  curve.  Figure  4  shows  the  PSFS  data  obtained  by  Blakemore  et  al.,  (1970).  [The  figure  is 
based  on  Klein  et  al.  (1974,  their  Fig.  8).J  If  the  adapting  frequency  is  lower  than  the  test  (negative 
value  on  the  abscissa),  then  the  frequency  of  the  test  appears  higher  following  adaptation 
(frequency  ratio  >1).  On  the  other  hand,  if  the  adapting  frequency  is  higher  than  that  of  the  test, 
then  the  frequency  of  the  test  appears  lower  following  adaptation.  The  peak  effects  occur  when  the 
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adapting  and  test  gratings  differ  by  about  0.5  octave.  By  making  the  retinal  frequency  of  the 
adapting  grating  lower  than  that  of  the  test  and  its  perceived  frequency  higher  (by  the  same 
amount),  opposite  predictions  are  achieved.  If  the  PSFS  is  tied  to  retinal  spatial  frequency,  then  the 
test  grating  should  appear  to  have  a  higher  spatial  frequency  following  adaptation.  On  the  other 
hand,  if  the  PSFS  is  tied  to  perceived  spatial  frequency,  then  the  test  grating  should  appear  to  have 
a  lower  spatial  frequency  following  adaptation. 

In  the  experiment  reported  here,  the  retinal  spatial  frequency  of  the  adapting  grating  was 
1.88  c/deg,  presented  at  1  meter,  whereas  that  of  the  average  test  was  2.62  c/deg,  presented  at  2 
meters.  The  object  spatial  frequency  of  the  adapting  grating  was  1.08  c/cm  and  that  of  the  average 
test  was  0.76  c/cm.  Thus,  the  perceived  frequency  of  the  adapting  grating  was  higher  than  that  of 
the  test,  but  its  retinal  frequency  was  lower  than  that  of  the  test. 


Spatial  Frequency  of  Adapting  Grating 
Relative  to  Test  (octaves) 


Figure  4.  PSFS  curve.  Data  by  Blakemore  ei  al.,  (1970)  as  reported  by  Klein  ct  al.  (1974). 
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Results 

Results  of  the  adapted  and  unadapted  conditions  for  two  observers  are  shown  in  Fig.  5. 
The  PSFS  effect  is  clearly  replicated:  The  perceived  frequency  of  the  test  grating  is  shifted 
following  adaptation  to  the  high-contrast  grating.  Furthermore,  this  result  was  obtained  with  much 
briefer  adapting  durations  than  were  used  in  the  frequency  discrimination  experiments,  where  no 
adaptation  effects  were  found.  The  magnitude  of  the  effect  obtained  here  is  similar  to  that  obtained 
by  Klein  et  al  and  considerably  smaller  than  that  obtained  by  Blakemore.  The  points  of  subjective 
equality  (PSE)  for  the  frequencies  of  the  two  gratings  are  shown  in  Table  1. 

Pattern  adaptation  raises  the  perceived  spatial  frequency  of  the  grating  seen  in  the  (upper) 
adapting  hemifield.  This  is  what  one  would  expect  on  the  basis  of  the  retinal  spatial  frequencies  of 
the  adapting  and  test  gratings.  It  contradicts  the  prediction  based  on  the  perceived  spatial 
frequencies  of  the  gratings.  Thus,  the  perceived  spatial  frequency  shift  that  results  from  prior 
adaptation,  like  the  contrast-threshold  elevation  effect,  must  occur  at  a  stage  of  processing  in  which 
the  spatial  properties  of  the  retinal  image  itself  are  represented,  a  stage  that  presumably  precedes 
estimates  of  object  properties. 
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At  /» 

(top  -  bottom  frequency)/top  frequency 

Figure  5.  Effect  of  pattern  adaptation  on  perceived  spatial  frequency  of  grating.  Adapted  data  are  shown  by  the  tilled 
symbols,  unadapted  by  the  open  symbols.  The  effect  of  pattern  adaptation  is  to  raise  the  perceived  frequency  of  the 
subsequently  viewed  test  grating.  Two  observers. 


Serial  Stages  in  Spatial  Processing:  Evidence  from  Pattern  Adaptation  Effects 
C.  A.  Burbeck 


Table  1 

Af/f  at  Point  of  Subjective  Equality 

Observer 

Unadopted 

Adapted 

MBO 

+.126 

-6.92 

EBF 

-.20 

-4.61 

Negative  values  indicate  that  the  grating  in  the  top  (adapted)  hemifield  appeared  to  have  a  higher 
spatial  frequency  than  the  grating  in  the  bottom  hemifield. 


PERCEIVED  SPATIAL  FREQUENCY  SHIFT 
WITH  SIMULTANEOUS  SURROUND 

Although  Klein  et  al.  (1974)  give  evidence  that  the  prior-adaptation-PSFS  and  the 
simultaneous-surround-PSFS  have  the  same  origin,  some  interesting  issues  remain.  Specifically, 
we  explored  two  basic  questions: 

•  Is  the  effect  of  the  surround  tied  to  the  relationship  between  the  retinal  spatial 
frequencies  of  the  test  and  surround  or  to  the  relationship  between  their  prcceived 
spatial  frequencies? 

•  Does  the  surround  PSFS  still  occur  if  the  test  gratings  being  compared  have  the  same 
perceived  spatial  frequencies  but  different  retinal  frequencies? 


These  questions  had  to  be  answered  with  more  informal  experimental  techniques  than  were  used  m 
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previous  experiments  because  of  the  difficulty  of  generating  the  stimuli  on  CRT's.  Although  one 
can  easily  display  a  test  grating  with  a  surrounding  grating  on  a  single  screen,  it  is  more  difficult  if 
the  surrounding  grating  has  to  appear  at  a  different  distance  than  the  test.  Therefore,  we  resorted  to 
paper,  scissors,  and  square  wave  gratings  (i.e.,  bars)  using  a  Macintosh  computer  and  laser  printer 
to  generate  the  stimuli.  This  approach  turned  out  to  be  satisfactory. 

Square  wave  gratings  of  three  fundamental  spatial  frequencies  were  printed  on  paper  -  the 
test  frequency,  twice  the  test  frequency,  and  half  the  test  frequency.  The  test  gratings  were 
presented  against  the  two  surrounds  as  shown  in  Fig.  6.  Viewing  in  all  cases  was  binocular  in  a 
room  with  normal  illumination.  The  white  surrounds  between  the  test  and  surround  gratings  were 
used  so  that  good  depth  cues  could  be  achieved  in  the  nonequidistant  condition.  In  the  equidistant 
condition,  the  stimuli  appeared  as  shown  in  Fig.  6  and  were  presented  at  a  viewing  distance  of  1 
meter.  In  the  nonequidistant  condition,  the  surround  gratings  were  presented  at  one  meter,  and  the 
test  gratings  were  presented  at  two  meters.  The  test  plus  white  surround  was  cut  out  of  the  Fig.  6 
stimulus  so  that  the  test  gratings  could  be  viewed  through  the  resulting  holes.  In  the  nonequidistant 
condition  the  object  spatial  frequency  of  the  test  gratings  was  half  that  used  in  the  equidistant 
condition,  and  the  test  patches  were  twice  the  size.  Therefore  the  test  patches  had  the  same  retinal 
dimensions  when  viewed  through  the  holes  in  the  surround  gratings  as  they  had  when  presented  in 
a  single  plane.  Under  these  conditions,  the  observers  perceived  the  test  gratings  as  lying  behind 
the  surround  gratings. 

In  both  the  equidistant  and  nonequidistant  conditions,  the  normal  PSFS  was  seen  as 
predicted  on  the  basis  of  the  retinal  spatial  frequencies.  Changing  the  viewing  distance,  while 
keeping  the  retinal  frequencies  the  same,  had  no  effect.  In  addition,  we  found  that  placing  the  test 
gratings  in  front  of  the  surround  gratings  also  resulted  in  the  predicted  effect.  Therefore,  the 
influence  of  the  surround  must  occur  at  a  stage  of  processing  in  which  the  retinal  spatial  frequencies 
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are  represented,  independent  of  their  perceived  spatial  frequencies. 

However,  the  whole  phenomenon  cannot  be  accounted  for  at  that  stage.  The  test  gratings 
are  still  compared  on  the  basis  of  their  object  spatial  frequencies.  Although  this  conclusions  seems 
to  follow  directly  from  the  results  of  our  previous  experiments  (Burbeck,  1 987),  it  seemed  prudent 
to  check  that  the  PSFS  and  the  comparison  of  object  spatial  frequencies  were  consistent.  Toward 
this  end,  we  conducted  the  following  experiment.  We  presented  the  two  halves  of  the  stimulus 
shown  in  Fig.  6  at  different  viewing  distances,  so  that  the  test  patches  differed  in  retinal  spatial 
frequency.  (This  can  be  done  by  the  reader  by  photocopying  the  figure  and  cutting  the  copy  in 
half.)  Over  the  range  of  distances  in  which  size  constancy  holds  well  (an  arms  length  and 
three-quarters  of  that  are  good),  the  test  patches  appear  essentially  the  same  as  in  the  equidistant 
case,  complete  with  the  perceived  spatial  frequency  shift.  Thus,  although  the  bias  caused  by  the 
surrounding  grating  occurs  at  a  stage  of  processing  in  which  retinal  spatial  frequencies  are 
represented,  the  comparison  between  the  two  test  patches  occurs  at  a  stage  in  which  the  object 
spatial  frequencies  are  estimated.  Thus,  one  can  begin  to  see  evidence  for  at  least  two  serial  stages 
of  processing. 

This  result  is  particularly  interesting  because  when  the  stimuli  are  presented  at  a  single 
viewing  distance  the  surround-PSFS  is  accompanied  by  a  shift  in  the  perceived  distances  to  the 
tests.  The  high-frequency  surround  appears  closer  than  the  test  and  the  low-frequency  surround 
appears  farther.  The  robustness  of  the  PSFS  across  changes  in  the  distances  to  the  test  and 
surrounds  suggests  that  the  difference  in  perceived  distances  induced  by  the  surrounds  does  not 
cause  the  effect,  but  is  instead  a  result  of  the  perceived  frequency  shift  itself.  ITiis  is  also  consistent 
with  our  finding  that  the  PSFS  occurs  before  depth  information  is  incorporated  into  the  analysis  of 
the  scene. 
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Figure  6.  Stimulus  for  informal  experiments  on  the  effects  of  depth  on  the  surround-PSFS. 

RELATIONSHIP  BETWEEN  PSFS  AND  FREQUENCY 
DISCRIMINATION  THRESHOLDS 

Although  the  frequency-discrimination-threshold  elevation  effect  is  apparently  not  very 
robust,  the  PSFS  is  more  so,  and  it  predicts  that  there  should  be  a  change  in 
frequency-discrimination  thresholds  following  pattern  adaptation.  Consider,  once  again,  the 
standard  PSFS  effect,  as  shown  in  Fig.  4.  If  the  frequencies  of  the  two  gratings  in  a 
frequency-discrimination  test  pair  flank  the  adapting  frequency,  then  the  test  frequency  that  is 
higher  than  the  adapting  frequency  should  appear  higher  still,  whereas  the  test  frequency  that  is 
lower  than  the  adapting  frequency  should  appear  lower  still.  Thus,  the  perceived  difference 
between  these  two  frequencies  should  be  greater  following  adaptation,  resulting  in  a  lower 
frequency-discrimination  threshold.  On  the  other  hand,  if  the  test  frequencies  are  both  higher  or 
both  lower  than  the  adapting  frequency,  and  within  the  range  of  the  PSFS  effect,  then  their 
perceived  difference  may  be  smaller  following  adaptation  --  the  perceived  frequencies  being 
bunched  together  at  frequencies  about  0.5  octave  higher  or  0.5  octave  lower  than  the  adapting 
frequency. 

The  exact  changes  in  frequency-discrimination  thresholds  that  this  analysis  predicts  are 
readily  calculated.  1  assume  that  the  frequency  discrimination  threshold  is  a  3%  difference  in  the 
perceived  frequencies.  The  actual  frequencies  that  would  result  in  a  3 7c  difference  in  the  peivei\C( 
frequencies  following  adaptation  can  then  be  rdetermined  from  PSFS  data. 

Let  a;  represent  the  perceived  frequency  of  spatial  frequency  fj.  follow  ing  adaptation  to 
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frequency  f.  Then  a;  =  R;fj,  where  Rj  is  the  frequency  ratio  measured  in  PSFS  experiments. 
Were  assuming  that  at  threshold  Af/f  =  .03.  Therefore,  it  follows  that  at  threshold, 


2(R2f2  “  **ity 

_  =.03  (1) 

1*2*2  +  1*1*1 


Equation  ( 1 )  can  be  rearranged  to  yield: 

2.03  R, 

f2  = - — 

1.97  R2 


and,  by  definition, 


Substituting,  we  find  that 


Af  2(f2-fj) 


f,  +  f, 


Af  4.06  Rj -3.94  R2 

_ =  -  (2) 

f  2.03  Rj  +  1.97  R2 


In  our  calculations  the  exact  values  of  Rj  that  were  required  were  obtained  by  interpolating 
linerarly  between  the  data  points.  The  resulting  predictions  are  shown  in  Fig.  7.  This  figure  shows 
predictions  based  on  the  data  of  Blakemore  et  al.  (1970)  and  on  the  data  of  Klein  et  al.  (1974).  The 
original  data  from  these  two  laboratories  differed  significantly,  so  that  predictions  based  on  their 
data  also  differ  significantly.  The  data  of  Blakemore  et  al.  (open  diamonds)  predict  a  large  decrease 
in  the  frequency  discrimination  threshold  at  the  adapting  frequency  and  small  frequency 
discrimination  threshold  elevations  above  and  below  the  adapting  frequency.  The  data  of  Klein  et 
at.  (filled  diamonds)  make  much  more  modest  predictions.  Their  data  predict  a  small  decrease  in 
frequency  discrimination  thresholds,  at  the  adapting  frequency  and  negligible  effects  above  and 
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below  the  adapting  frequency.  Our  data,  which  are  also  shown  in  Fig.  7  (filled  squares),  are 
roughly  consistent  with  the  predictions  of  Klein  et  al.  By  contrast,  Regan  and  Beverley  found  larg 
threshold  elevations  when  the  test  frequency  was  higher  than  the  adapting  frequency  (negative 
values  on  the  abscissa).  Representative  data  from  their  study  are  shown  in  Fig.  8  together  with  the 
predictions  from  the  two  sets  of  PSFS  data  for  comparison.  Neither  of  the  PSFS  functions 
predicts  the  large  threshold  elevations  that  Regan  and  Beverley  found. 


Adapt  Frequency/Test  Frequency  (octaves) 


Figure  7.  Effects  of  pattern  adaptation  on  frequency  discrimination  predicted  by  PSFS  data  of  Blakemore  et  al.  (open 
diamonds,)  and  predictions  based  on  data  of  Klein  et  al.  (filled  diamonds).  Also  shown  for  comparison  are  the  data 
obtained  in  our  lab  (filled  squares).  Vertical  and  horizontal  scales  chosen  to  match  those  used  in  Fig.  8. 
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Figure  8.  The  triangles  show  typical  result  from  Regan  and  Beverley  (1983,  their  Fig.  1).  Also  shown  for 
comparison  are  the  predictions  based  on  the  PSFS  data  of  Klein  et  al.  (filled  diamonds),  and  those  based  on  the  data  of 
Blakemore  et  al.  (open  diamonds). 


Relating  the  PSFS  to  the  frequency-discrimination  thresholds  suggests  a  functional 
advantage  for  this  form  of  pattern  adaptation:  Prolonged  viewing  (and  hence  intense  interest  in)  a 
high-contrast  stimulus  enhances  sensitivity  to  changes  in  the  size  (and  hence  distance  to)  the 
stimulus.  Thus,  prolonged  viewing  may  result  in  slightly  enhanced  sensitivity  to  slow  forward  or 
backward  motion  of  the  object  of  interest. 


SUMMARY  AND  DISCUSSION 


The  experiments  reported  above  show  that  both  the  contrast- threshold  elevation  and  the 
PSFS  that  result  from  pattern  adaptation  are  tied  to  the  retinal  spatial  frequencies  of  the  test  and 
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adapting  gratings,  independent  of  their  perceived  spatial  frequencies.  In  short,  all  effects  of  pattern 
adaptation  appear  to  be  restricted  to  fairly  distal  representations  of  spatial  information.  Thus,  the 
fact  that  pattern  adapation  effects  appear  in  frequency  discrimination  tasks  suggests  that  there  is  a 
serial  relationship  between  the  channels  stage  and  the  stage  in  which  spatial  frequency  judgments 
are  made.  This  supports  the  idea  that  the  processing  stage  that  is  revealed  by  pattern  adaption 
paradigms  is  fundamental  to  spatial  vision  in  general. 
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Abstracl— Spatial  frequency  and  orientation  selectivity,  the  most  prominent  properties  of  image 
processing  in  the  striate  cortex,  are  not  uniform  throughout  the  spatiotemporal  frequency  domain  Some 
current  models  include  one  "transient"  mechanism  at  very  high  velocities  (i.e  low  spatial  and  high 
temporal  frequencies),  and  multiple  "sustained"  mechanisms  elsewhere  in  the  spatiotemporal  frequency 
domain,  but  they  do  not  consider  the  parameter  of  orientation.  On  ihe  basis  of  earlier,  orthogonal  masking 
experiments,  we  concluded  that  the  high-velocity  mechanism  is  sensitive  to  a  broad  band  of  spatial 
frequencies,  and  has  little  or  no  orientation  selectivity.  In  the  present  study  we  use  pattern  adaptation  to 
measure  the  spatiotemporal  properties  of  this  mechanism.  In  other  experiments,  we  attempt  to  relate  it 
to  the  direction-selective  motion  detectors  that  also  respond  at  high  velocities  Finally  we  compare  the 
pattern-adaptation  results  to  the  results  of  orthogonal  subthreshold  summation  experiments  in  the  same 
region  of  high  temporal  and  low  spatial  frequencies 

Pattern  adaptation  Spatiotemporal  mechanisms  High  velocity  Pattern 'flicker 

Transient/sustained  Orientation  selectivity  Motion  detectors  Subthreshold  summation 


INTRODUCTION 

Recent  research  in  spatial  vision  has  been  dom¬ 
inated  by  the  theory  that  there  are  multiple 
parallel  channels,  each  sensitive  to  a  different 
range  of  spatial  frequencies  (Blakemore  and 
Campbell,  1969;  Kelly  and  Burbeck,  1984).  De¬ 
veloping  concurrently  with  that  theory  was  the 
idea  that  there  are  two  types  of  mechanisms, 
often  called  sustained  and  transient,  that  have 
different  temporal  as  well  as  spatial  proper¬ 
ties  (Tulunay-Keesey,  1972;  Tolhurst,  1973; 
Kulikowski  and  Tolhurst,  1973;  Pantle,  1973). 
More  recently  these  two  approaches  have  been 
reconciled  by  the  suggestion  that  there  is  a  single 
mechanism  that  is  most  sensitive  to  high  tempo¬ 
ral  and  low  spatial  frequencies — the  so-called 
transient  mechanism — and  multiple  sustained 
mechanisms  handling  the  rest  of  the  spatio- 
temporal  frequency  domain  (Legge,  1978).  In 
this  model,  each  sustained  mechanism  has  nar¬ 
rower  tuning  for  spatial  frequency  than  does  the 
transient  mechanism;  orientation  tuning  is  not 
considered 

Although  the  terms  “sustained"  and  “tran¬ 
sient”  are  generally  used  to  describe  electro- 
physiological  responses,  numerous  attempts 
have  been  made  to  link  particular  visual  per¬ 
cepts  to  one  or  the  other  of  these  mechanisms. 
For  example,  percepts  of  pattern  and  flicker  (or 


form  and  motion)  were  thought  to  arise 
specifically  from  the  responses  of  sustained  and 
transient  mechanisms,  respectively  (Tulunav- 
Keesey,  1972;  Tolhurst,  1 973)  Now,  however, 
there  is  ample  evidence  that,  although  there  may 
be  parallels  between  some  higher  order  percepts 
and  more  peripheral  detection  mechanisms 
there  are  no  identities  between  them  (Green, 
1984).  Thus  psychophysically  determined 
thresholds  may  be  more  successful  than  subjev 
tive  percepts  in  determining  the  properties  ol 
these  two  subsystems  (Lenme.  1980,  Burbeck, 
1981). 

The  present  study  is  mainly  concerned  with 
what  has  been  called  the  “transient"  mech¬ 
anism.  However,  the  terms  "sustained"  and 
“transient"  properly  indicate  only  the  presence 
or  absence  of  a  steady-state  response,  so  we 
prefer  to  identify  these  mechanisms  in  terms  of 
the  spatiotemporal  frequency  regions  where 
they  are  most  sensitive  We  regard  the  “tran¬ 
sient"  mechanism,  for  example,  as  the  low 
spatial,  high-temporal  frequency  mechanism 

In  order  to  avoid  using  such  cumbersome 
terms  throughout  the  paper,  we  take  advantage 
of  the  fact  that,  when  the  stimuli  arc  moving  m 
flickering  sinusoidal  gratings,  the  stimulus  vc 
locity  always  equals  the  ratio  of  its  temporal  to 
its  spatial  frequence  1 1 '  =  /,  f)  Thus  we  call 
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our  stimuli  “high-velocity "  or  "low-velocity " 
gratings,  if  they  occur  in  the  appropriate  regions 
of  the  spatiotemporal  frequency  domain 

We  use  these  terms  for  convenience  only,  they 
are  not  intended  to  imply  any  type  of  velocity 
tuning  other  than  that  described  above.  Where 
both  spatial  and  temporal  frequencies  are  high, 
or  both  are  low,  we  state  this  explicitly  With 
these  conventions,  it  becomes  natural  to  refer  to 
the  mechanism  that  is  optimally  stimulated  by 
(relatively)  low  spatial  and  high  temporal  fre¬ 
quencies  as  the  “high-velocity"  mechanism 
This  has  the  advantage  of  brevity,  without 
implying  that  this  mechanism  has  no  steady- 
state  response. 

In  a  previous  study,  we  found  that  masking 
by  an  orthogonal  gratinc  of  the  same  spatial 
and  temporal  frequency  as  the  test  grating  pro¬ 
duced  substantial  contrast  threshold  elevation 
when  both  the  test  and  mask  were  of  high 
velocities,  but  not  in  any  other  frequency  region 
(Burbeck  and  Kelly,  1981)  In  that  paper,  we 
interpreted  this  to  mean  that  there  were  two 
types  of  mechanism,  one  type  in  the  high- 
velocity  region,  and  one  type  elsewhere  in  the 
spatio-temporal  frequency  domain.  The  fact 
that  orthogonal  masking  had  a  profound  effect 
in  the  high-velocity  region  suggested  that  the 
underlying  mechanism  in  that  region  is  not  as 
narrowly  tuned  for  orientation  as  are  the  mech¬ 
anisms  responsible  for  thresholds  in  the  rest  of 
the  spatiotemporal  frequency  domain.  We  also 
found  that  the  mechanism  in  the  high-velocity 
region  is  more  broadly  tuned  for  spatial  fre¬ 
quency  than  are  the  other  mechanisms  that  have 
been  revealed  in  masking  studies.  This  result 
was  confirmed  and  extended  by  Ferrara  and 
Wilson  (1985) 

In  the  present  study,  we  measure  the  orien¬ 
tation  selectivity  of  this  high-velocity  mech¬ 
anism,  using  a  pattern-adaptation  paradigm 
We  did  not  do  this  during  the  previous  study 
because  the  masking  paradigm  was  unsuitable 
for  determining  orientation  selectivity.  (When 
the  mask  and  test  are  aligned,  the  task  becomes 
contrast  discrimination  rather  than  contrast 
detection  )  With  the  present  pattern-adaptation 
paradigm,  we  find  that  thresholds  are  elevated 
at  high  velocities  when  the  test  and  adapting 
gratings  are  orthogonal,  just  as  we  found  using 
orthogonal  masking  Moreover,  we  find  that 
the  high-velocity  mechanism  actually  behaves 
isotropically  when  the  spatial  frequency  is 
sufficiently  low  and  the  temporal  frequency  is 
sufficiently  high 


METHODS 

(a)  Equipment 

The  apparatus  used  in  these  experiments  has 
been  described  elsewhere  (Kelly.  1982)  The 
experimental  procedures  were  controlled  by  a 
computer  that  also  generated  the  stimulus  func¬ 
tions,  and  collected  and  processed  the  subject's 
responses.  The  stimuli  were  displayed  at  a  60-H/ 
frame  rate  on  a  30-cm,  high-resolution  monitor, 
subtending  8  deg  at  the  2-m  viewing  distance 
Mean  luminance  of  the  screen  was  90  cd  nr  All 
observations  were  made  monocularly,  with  the 
right  eye.  using  a  3-mm  artificial  pupil  Fixation 
was  controlled  by  stabilizing  the  retinal  image 
with  the  SRI  eyetracker  (Crane  and  Steel,  I9"’8, 
Crane  and  Clark.  1978) 

(h)  Procedure 

The  question  of  whether  to  use  drifting  or 
flickering  stimuli  required  some  consideration 
In  our  masking  study  (Burbeck  and  Kell\. 
1981),  we  used  counterphase  gratings  through 
out,  but  here  prolonged  viewing  of  high  - 
contrast,  counterphase  gratings  could  produce 
second-harmonic  afterimages  (Virsu  and  Lau- 
nmen,  1977),  which  are  particularly  strong  with 
stabilized,  high-velocity  gratings.  These  after 
images  can  be  avoided  by  adapting  with  moving 
gratings  instead  of  counterphase  gratings,  but 
then  we  must  consider  direction-selective 
motion  aftereffects  (Sekuler  and  Ganz,  1963. 
Levinson  and  Sekuler,  1975).  In  our  main 
experiments,  we  drifted  the  adapting  stimulus 
(to  avoid  afterimages)  and  flickered  the  test 
stimulus  (to  avoid  motion  aftereffects)  To 
confirm  that  these  test  thresholds  were,  in  fact, 
unaffected  by  adaptation  of  motion  detectors, 
we  also  conducted  a  few  motion-adaptation 
experiments  at  appropriate  spatial  and  temporal 
frequencies  [see  Results  (e)]. 

The  adapting  stimulus  was  usually  a  vertical 
grating,  drifting  horizontally  at  the  appropriate 
velocity,  while  the  test  stimulus  was  a 
counterphase-ffiekering  grating,  usually  hori¬ 
zontal,  but  sometimes  vertical  or  at  ±45  deg  In 
a  few  cases,  the  adapting  stimulus  was  oriented 
at  45  deg  and  the  test  at  other  orientations 

Pattern-adaptation  experiments  have  tradi¬ 
tionally  used  the  method  of  adjustment,  but  we 
adopted  a  computer-controlled,  yes/no  staircase 
technique  for  all  the  adaptation  experiments 
reported  here  Each  trial  consisted  of  an  18-scc 
adapting  interval  followed  by  a  3-sec  test  inter¬ 
val  In  addition,  the  contrasts  of  both  the  adapt- 
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ing  and  the  test  stimulus  were  faded  in  and  out 
by  a  1-sec,  raised-cosine  waveform  at  the  begin¬ 
ning  and  end  of  each  interval,  making  their  total 
durations  20  and  5  sec,  respectively.  However, 
the  test  interval  could  be  terminated  by  the 
subject  at  any  time  after  the  test  reached  full 
contrast,  if  he  signalled  “yes”  or  “no."  (When 
we  measured  the  unadapted  threshold,  the 
adapting  interval  was  blank,  but  the  timing 
remained  the  same  )  In  preliminary  tests,  the 
subject’s  (adapted  or  unadapted)  threshold  was 
estimated  by  the  method  of  adjustment,  and  the 
staircase  was  started  at  this  contrast.  The  adapt¬ 
ing  stimulus  was  always  displayed  at  95%  con¬ 
trast  (after  fading  in). 

A  tone  sounded  near  the  beginning  of  the  test 
interval,  to  cue  the  subject  At  any  time  after 
this  tone,  he  could  indicate  by  pushing  a  button 
whether  or  not  he  detected  the  test  stimulus  For 
each  yes  response,  the  test  contrast  in  the  next 
trial  was  decremented  by  10%;  for  each  no 
response,  it  was  incremented  by  10%.  The  stair¬ 
case  was  terminated  after  six  pairs  of  reversals 
of  test  contrast  Threshold  was  defined  as  the 
average  of  these  (12)  reversal  contrasts  No 
preadapting  period  was  used,  but  there  was 
rarely  any  significant  increase  of  threshold  after 
the  first  reversal  (If  the  threshold  did  increase 
during  reversals,  data  from  that  run  were  not 
used  ) 

(i  )  Sub/eds 

The  data  reported  here  were  all  obtained  from 
two  subjects  The  most  complete  set  was  from 
one,  young,  emmetropic,  naive  subject 
(A  E  M  ).  However,  his  results  were  spot- 
checked  and  all  the  important  ones  replicated  by 
a  more  experienced  subject  (D  H.K.). 

RESULTS 

(a)  Orthogonal  adaptation 

We  define  orthogonal  pattern  adaptation  as 
an  increase  of  threshold  for  a  test  grating  fol¬ 
lowing  adaptation  to  a  high-contrast  grating 
whose  orientation  is  orthogonal  to  that  of  the 
test  In  our  first  experiments,  the  test  and  adapt¬ 
ing  stimuli  had  the  same  temporal  and  spatial 
frequencies  tthus,  this  paradigm  could  be  called 
“orthogonal  self-adaptation")  To  quantify  the 
adaptation  effect,  we  used  the  ratio  (R)  of  the 
adapted  threshold  to  the  unadapted  one  Be¬ 
cause  each  adapted  threshold  was  measured 
shortly  after  its  unadapted  control,  this  ratio 
showed  very  little  of  the  long-term  variation  in 


sensitivity  that  often  afflicts  raw  data  ildea'  . 
R  -  I  would  represent  no  effect,  allow  re  1  • 
residual  noise,  we  treated  any  value  >-1  A  less 
than  1.1  as  representing  no  significant  efkvi 

Our  first  orthogonal  adaptation  tests  were 
conducted  under  two  conditions  chosen  on  the 
basis  of  our  previous  masking  study  In  one 
condition  (a  low  veloct'v)  we  had  found  no 
orthogonal  masking,  and  in  the  other  condition 
(a  high  velocity)  we  had  found  a  large  orthog¬ 
onal  masking  effect.  In  the  low-velocity  condi¬ 
tion,  we  also  found  no  significant  orthogonal 
adaptation  effect,  confirming  previous  pattern- 
adaptation  studies  of  orientation  selectiv  ity  In 
the  high-velocity  condition,  we  obtained  large 
effects  of  orthogonal  adaptation:  The  threshold 
for  a  horizontal  grating  was  roughly  tripled  by 
adaptation  to  a  vertical  one 

This  form  of  pattern  adaptation  was  pre¬ 
viously  unknown,  and  it  seemed  important  to 
map  the  extent  of  its  occurrence  in  the  spatio- 
temporal  frequency  domain  We  were  also  inter¬ 
ested  to  see  if  it  occurred  in  the  same  region  as 
the  orthogonal  masking  effects  we  reported 
previously.  We  therefore  extended  our  orthog¬ 
onal  adaptation  tests  to  a  number  of  different 
spatial  and  temporal  frequency  combinations 
within  the  high-velocity  region,  paying  special 
attention  to  the  boundary  zone  in  which  the 
effect  tapered  off  to  insignificance  The  results  of 
these  experiments  are  shown  as  spot  values  for 
subject  A.E.M  in  Fig  1.  When  these  threshold- 
elevation  data  arc  plotted  versus  log  frequency, 
the  functions  obtained  are  almost  linear  Thus, 
points  not  measured  can  be  readily  interpolated 
to  obtain  a  plausible  approximation  to  the 
complete  surface  Figure  1  also  shows  this  sui- 
face  plotted  as  a  contour  map  Contours  are 
given  for  threshold-elevation  ratios  from  1.2  to 
2.6,  at  contour  intervals  of  0  2  The  fit  of  the 
interpolated  surface  to  the  data  can  be  judged 
by  comparing  the  contours  in  Fig  1  to  the  spot 
values 

These  contours  are  approximately  constant- 
velocity  diagonals  for  much  of  their  range,  but 
they  curve  inward  away  from  the  diagonal  a: 
both  ends,  interacting  with  spatial  and  tempot.i, 
frequency  in  these  regions  Thus,  although  the 
data  are  not  consistent  with  a  mechanism  tl,,e 
is  simply  tuned  to  velocitv.  thev  are  not  .on  ; 
tent  with  a  mechanism  that  is  simple  tuned  n 
temporal  frequence  either,  contrarv  to  prcviou- 
suggestions 

However,  the  delineated  region  is  essential!-, 
coincident  with  the  orthogonal  masking  region 
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Fig  I  Contour  map  of  the  threshold-elevation  surface 
produced  by  orthogonal  self-adaptation,  as  described  in  the 
text  Contours  represent  elevation  ratios  from  1.2-2. 6 
Encircled  numbers  represent  the  data  from  which  this 
surface  was  constructed  The  dashed  diagonal  lines  repre¬ 
sent  constant  velocities  Thus  velocity  changes  most  rapidly 
in  the  orthogonal  direction  typified  by  the  solid  diagonal 
line  labelled  V  =  4  (see  text)  Subject,  A. E  M 


reported  by  Burbeck  and  Kelly  (1981),  as  shown 
in  Fig  2.  All  adaptation  ratios  in  the  region  of 
large  masking  effects  are  greater  than  1 .9;  in  the 
region  of  small  masking  effects,  they  fall  be¬ 
tween  1.2  and  1.7;  and  where  there  are  no 
significant  masking  effects,  they  are  less  than 
1.2 

In  the  previous  masking  study,  we  conducted 
a  few  orthogonal  adaptation  tests,  with  negative 
results.  However,  only  the  highest  velocity  we 
tested  (8  deg 'sec)  was  great  enough  to  permit  a 
measurable  threshold  elevation  according  to  the 
present  results,  and  it  did  show  a  20%  elevation. 
(In  the  following  section,  we  compare  that 
datum  with  present  data  for  the  same  subject 
(Fig.  4).]  The  results  of  the  two  studies  are  not 
inconsistent;  we  infer  that  they  could  be  probing 
the  same  mechanism. 

We  would  have  liked  to  determine  the  bound¬ 
aries  of  this  mechanism  at  higher  temporal  and 
lower  spatial  frequencies  than  those  used  here, 
but  we  were  unable  to  do  so  because  of  equip¬ 
ment  limitations  (We  did  lower  the  spatial 
frequency  still  further  in  some  tests  by  de¬ 
creasing  the  viewing  distance,  as  reported  be¬ 
low  )  The  data  of  Figs  I  and  2  suggest  that 


G 


orthogonal  adaptation  occurs  at  even  higher 
velocities  (i.e.  lower  spatial  and/or  higher  tem¬ 
poral  frequencies)  than  we  measured,  but  we  did 
not  establish  the  outer  bounds  of  this  effect 

(b)  Orientation  selectivity 

The  threefold  elevation  in  threshold  produced 
by  orthogonal  adaptation  in  the  high-velocity 
region  indicates  that  its  underlying  mechanism 
is  not  as  orientation-selective  as  the  mechanism 
that  is  measured  in  the  traditional  pattern- 
adaptation  experiments  at  high  spatial  and 
low  temporal  frequencies  (Blakemore  and 
Nachmias,  1971;  Kulikowski  et  al.,  197?)  We 
therefore  sought  to  determine  the  orientation 
selectivity  of  this  high-velocity  mechanism  We 
repeated  the  threshold  elevation  tests  using  a 
very  high  velocity  (0.25  c/deg,  15  Hz,  at  a  view¬ 
ing  distance  of  2  m)  with  the  test  grating  ori¬ 
ented  at  several  angles  relative  to  the  adapting 
grating  (0,  45,  90  and  -45  deg).  Results  for  the 
same  subject  used  in  Fig.  1  are  given  in  Table  1 , 
and  are  plotted  in  polar  coordinates  in  Fig  3(a) 
Results  for  another  observer  (obtained  at 
0.089  c/deg,  10  Hz,  with  a  viewing  distance  of 
1  m)  are  also  given  in  Table  1  and  are  plotted  in 
Fig.  3(b). 

At  the  extreme  spatial  and  temporal  fre¬ 
quencies  used,  the  threshold-elevation  ratio 
for  both  subjects  is  essentially  independent  of 
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Table  I 


60  deg/jec  (15  Hi,  0.25  cy/deg) 


£  MEASURED  THRESHOLD  ELEVATION 
0  REFLECTED  points 
(a) 


DHK 


112  deg/j«c  (10  Hi  0  089  cy/d«g) 


0  MEASURED  THRESHOLD  r  .EVATION 
O  REFLECTED  POINTS 


(b) 

Fig  3  Polar  plots  of  threshold  elevation  as  a  function  of 
test-grating  orientation  (a)  subject  A  E  M  .  at  a  velocity  of 
60  deg,  sec,  (15  He.  0  25  cdegl.  (b)  subject  DHK  at  a 
velocity  of  1 1 2  deg  sec  1 10  Hz.  0  089  c  deg)  This  condition 
was  obtained  by  halving  the  viewing  distance  (approxi¬ 
mately  doubling  the  field  sizel,  so  the  actual  ratios  may  not 
be  comparable  to  those  in  the  other  figures  Only  four  points 
were  measured  in  each  figure  but  their  reflections  are  also 
shown,  to  indicate  that  180-deg  rotation  of  a  flickering 
grating  does  not  change  the  stimulus 

the  orientation  of  the  test  grating:  it  shows  no 
significant  orientation  selectivity.  The  circle 
drawn  through  the  points  in  each  figure  is  the 
theoretical  locus  for  a  perfectly  isotropic  mech¬ 
anism  The  data  conform  well  to  this  theoretical 
form 
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To  quantify  the  shift  from  the  strongly- 
oriented  response  at  low  velocities  (which  ap¬ 
pears  as  a  lemniscate  form  in  polar  coordinates  I, 
to  the  isotropic  response  at  high  velocities 
shown  in  Fig.  3,  we  measured  both  parallel  and 
orthogonal  adaptation  for  spatialtemporal  fre¬ 
quency  pairs  lying  along  a  diagonal  path,  run¬ 
ning  from  the  low-velocity  corner  to  the  high- 
velocity  corner  of  the  spatiotemporal  frequency 
domain,  as  shown  in  Fig.  I  (The  equation  of 
such  a  path,  at  right  angles  to  all  constant- 
velocity  profiles,  is  /S/T  =  U ,  where  U  is  a  con¬ 
stant.  Here  we  followed  the  line  l'  =4.) 

Figure  4  shows  the  threshold  elevation  ratios 
for  both  parallel  and  orthogonal  adaptation 
plotted  in  linear  units  as  a  function  of  log 
velocity  along  this  path  The  orthogonal  adap¬ 
tation  ratios  for  subject  A  E  M  [Fig  4(ai|  were 
obtained  by  interpolation  of  the  constant 
threshold-elevation  contours,  as  shown  in  Fig 
I  They  are  indicated  by  the  solid  curve  without 
data  points  The  orthogonal  adaptation  ratios 
for  subject  D  H  K  [Fig  4(b)]  were  measured  at 
two  points  in  this  study,  and  at  another  point  in 
a  previous  study  (discussed  above)  These  data 
are  shown  by  the  open  symbols,  the  solid  curve 
through  those  points  was  drawn  by  eye  The 
solid  symbols  in  both  parts  of  the  figure  repre¬ 
sent  parallel  adaptation  ratios  measured  at  vel¬ 
ocities  of  0.25,  4  and  60  deg  sec  [also  20  deg  sec 
in  Fig  4(b)],  spanning  the  conslant-U  line  The 
solid  arrow  in  Fig  4(a)  indicates  the  velocity 
used  for  Fig  3(a)  [The  velocity  used  for  Fig 
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Fig  4  Threshold  elevation  for  parallel  and  orthogonal 
adaptation  as  a  function  of  velocity:  (a)  subject  A  E  M  The 
orthogonal  adaptation  curve  (no  plotting  symbols!  was 
interpolated  from  the  contours  in  Fig  2,  along  the  path 
shown  by  the  solid  diagonal  in  that  figure  Threshold 
elevation  ratios  produced  by  parallel  adaptation  at  three 
velocities  along  the  same  path  are  shown  by  the  solid  circles, 
(b)  Same  as  (a),  but  for  subject  D.H  K  Ftere  data  points  are 
shown  for  both  orthogonal  and  parallel  adaptation  results 
Square  symbol  is  a  datum  for  Burbeck  and  Kelly  (1981), 
under  comparable  conditions. 


3(b)  is  not  included  on  this  graph  because  those 
data  were  obtained  at  a  different  viewing  dis¬ 
tance  and  field  size  ]  The  open  arrow  in  Fig.  4(b) 
indicates  the  velocity  used  subsequently  in 
Fig  5. 

Clearly  the  two  types  of  pattern  adaptation 
shown  in  Fig  4  behave  quite  differently  as 
functions  of  velocity  For  both  subjects,  orthog¬ 
onal  adaptation  increases  steadily  with  in¬ 
creasing  velocip. .  but  parallel  adaptation 
decreases  to  a  minimum  at  velocities  of  a  few 
degrees  per  second  and  then  increases,  ap¬ 
proaching  the  orthogonal  result  at  high  veloci¬ 
ties  However,  there  are  important  quantitative 
differences  between  the  data  of  the  two  subjects 
(These  differences  are  emphasized  by  the  log- 
linear  coordinate  system  chosen  for  Fig  4.) 

Subject  DHK  [Fig  4(b)]  shows  larger  adap¬ 
tation  effects  at  high  velocities  than  A.E.M. 


DHK 
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Fig  5.  Similar  to  Fig  3.  but  ai  a  velocity  of  20  deg  Vs 
(10  Hz,  0.5  c/deg),  as  indicated  by  the  open  arrow  in  }  ig 
4(b),  subject  DHK  The  dashed  lemmscair  represent  the 
putative  response  of  purely  orientation  tuned  mcchjniMv.* 
at  this  velocity  (see  text ) 

[Fig.  4(a)]  does,  and  smaller  effects  at  low 
velocities.  Thus,  the  effect  of  orthogonal  adapta¬ 
tion  for  DHK  falls  off  more  rapid  1>  with 
decreasing  velocity.  At  20  deg  sec.  the  orthog¬ 
onal  adaptation  effect  for  this  subject  is  about 
half  the  parallel  one  [as  indicated  by  the  arrow 
in  Fig.  4(b)],  to  obtain  that  ratio  for  A  E  M.,  the 
velocity  must  be  reduced  by  another  factor  of 
three.  These  individual  differences  are  consistent 
with  the  hypothesis  that  the  data  are  governed 
by  two  separate  mechanisms,  an  orientation- 
tuned  one  at  low  velocities,  and  an  isotropic  one 
at  high  velocities 

The  results  of  Fig  4  suggest  the  changing 
shape  of  orientation-tuning  curves  across  the 
spatiotemporal  frequency  domain  To  make  tins 
more  explicit,  wc  conducted  another  variable 
orientation  experiment  with  subject  DHK  at  .1 
velocity  of  20  deg  sec  (0.5c  deg.  10  Hz)  The 
results,  given  in  Table  I  and  plotted  in  l  ie  ' 
are  as  would  be  expected  At  this  velocity.  the 
onentation-tumng  curve  is  elliptical,  departing 
significantly  from  perfect  isotropism,  but  snl! 
far  from  the  lemniscate  shape  of  the  usual 
(low-velocity)  onentation-tumng  curves  (The 
10-deg  tilt  of  the  best-fitting  ellipse  in  fig  5  is 
caused  by  the  measured  ratios  for  +  45  deg  not 
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being  exactly  equal  We  have  no  explanation  for 
this  asymmetry  ) 

The  dashed  curves  in  Fig  5  suggest  that  these 
medium-velocit}  data  may  be  generated  by  a 
mixture  of  two  mechanisms,  one  orientation- 
tuned  and  the  other  isotropic  (The  lemniscate 
curve  was  formed  merely  by  subtracting  the 
dashed  circle  from  the  solid  ellipse,  to  illustrate 
the  point  It  seems  more  likely  that  two  such 
responses  would  combine  by  a  nonlinear  rule, 
but  our  data  provide  no  basis  for  selecting  one  ) 

(<■)  Spatial  and  temporal  bandwidths 

The  results  presented  so  far  suggest  the  exis¬ 
tence  of  a  broadband,  spatiotemporal  channel 
at  high  velocities  But  from  the  orthogonal 
self-adaptation  paradigm  described  above 
(where  the  orthogonal  test  and  adapting  gra¬ 
tings  have  the  same  spatial  and  temporal  fre¬ 
quencies),  we  cannot  infer  that  the  broadband 
results  of  Fig.  1  actually  represent  one  mech¬ 
anism  that  covers  this  large  region  in  the  spatio- 
temporal  frequency  domain  Alternatively, 
these  data  could  represent  the  envelope  of 
several  sub-channels,  each  more  narrowly  tuned 
in  spatial  or  temporal  frequency.  To  test  this 
possibility  we  conducted  some  experiments  with 
cross-adaptation  paradigms  (in  which  the  or¬ 
thogonal  test  and  adapting  gratings  are  of 
different  spatial  or  temporal  frequencies) 

To  infer  the  bandwidths  of  underlying  mech¬ 
anisms  from  these  adaptation  experiments 
requires  detailed  theoretical  assumptions  (Swift 
and  Smith,  1982).  but  such  quantitative  band¬ 
width  calculations  are  not  necessary  here  For 
the  presert  purpose,  we  need  only  invoke  the 
following  general  principle  If  we  are  dealing 
w  ith  an  array  of  narrow-band  mechanisms,  each 
tuned  to  a  different  region  of  the  spatiotemporal 
frequency  domain,  then  for  a  given  path  across 
this  domain,  the  self-adaptation  (or  self-test) 
paradigm  should  yield  a  broader  threshold- 
elevation  curve  than  docs  the  standard  cross¬ 
adaptation  (or  cross-test)  paradigm  in  which 
the  test  frequency  is  fixed  and  the  adapting 
frequency  varied,  or  vice  versa  (The  best- 
known  case  of  this  relationship  in  spatial  vision 
is  the  classic  spatial  frequency  tuning  result  )  On 
the  other  hand,  if  we  are  dealing  with  a  single, 
monolithic  mechanism,  then  the  self-adaptation 
curve  should  not  be  significantly  broader  than 
the  cross-adaptation  curve,  as  measured  across 
the  same  prolile  of  Fig  I 

Figure  6  shows  two  sets  of  cross-adaptation 
data  in  which  the  horizontal  test  stimulus  was 
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Fig  6  Threshold  elevation  ratios  obtained  - ,  .  r  •• 

adaptation  with  a  I5H/.  OT^cueg  test 
(60 deg  sec)  (a)  Effect  of  varying  the  :err.p  m  .  • 

the  adapting  stimulus,  with  a  constant  spa’ia  'w;  ,r-  . 
of  0.25  c  deg  and  (hi  effect  of  var\ing  the  spat:.i.  ’ rcoir.  ■ 
of  the  adapting  stimulus,  with  a  constant  levp,  \> 
quency  of  15  Hz  The  smooth  curves  rcprrv-r 
adaptation  profiles  interpolated  from  the  coni.uirv  )  „  . 
over  the  same  frequency  ranges  as  the  cross  adapt. s: 
data  Subject.  A  I  M 

held  constant  at  0  25  c  deg  and  1  5  Hz.  w bile  the 
adapting  stimulus  was  varied  in  temporal  Ire 
quency  [Fig.  6(a)]  or  spatial  frequenev  [Fig 
6(b)]  These  cross-adaptation  data  arc  shown  hv 
the  open  circles  The  arrow  above  each  graph 
indicates  the  frequency  of  the  fixed  test  stimuli. 
The  comparable  self-adaptation  results  (from 
Fig  li  are  shown  bv  the  solid  symbols  lie 
curve  was  obtained  bv  interpol  ion  <>:  the 
contours  in  Fig  I  over  the  same  range  . •: 
adapting  frequencies  There  is  no  suggestion  in 
these  data  that  the  self-adaptation  curve  (solid 
symbols  and  interpolated  curve)  is  broadei  than 
the  corresponding  cross-adaptation  result  (open 
symbols)  The  implication  of  this  result  is  that, 
at  these  spatial  and  temporal  frequencies,  we  are 
dealing  with  a  single,  monolithic  mechanism 

(d)  Adaptation  to  patternless  flicker 

The  results  of  Fig  I  suggest  that  the  broad 
band,  isotropic  response  may  peak  at  still  higher 
velocities  (i  e  higher  temporal  and  or  lower 
spatial  frequencies)  than  those  we  used  V 
though  the  temporal  frequency  u,h  limited 
the  frame  rate  of  the  display .  the  di  ■’  i..t:e 
spatial  frequency  of  the  stimulus  could  be  x 
cred  by  uniformly  flukering  the  is-deg  'le'-t 
(thereby  changing  its  frequency  do:-.1-..,-  • 

from  bandpass  to  low  pass)  The  cfkut  of  .td.iy 
tng  to  this  uniformly  flickering  held  w.o  m-.  , 
sured  with  horizontal  test  gratings  o!  o  2';  I  a?  d 
3c  deg.  in  a  cross-test  paradigm  tadap' mg 
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quency  held  constant  while  the  test  frequency  is 
varied).  All  stimuli  were  flickering  at  15  Hz. 

The  resulting  threshold-elevation  curve  is 
shown  in  Fig.  7  together  with  the  comparable 
results  from  the  orthogonal  self-adaptation  pa¬ 
radigm  and  the  curve  that  was  interpolated 
from  the  data  of  Fig  1.  The  uniform  flickering 
field  does  produce  larger  adaptation  effects  than 
does  self-adaptation,  but  these  effects  decay 
more  rapidly  with  increasing  spatial  frequency 
than  do  the  effects  produced  by  self-adaptation. 

Can  these  two  results  be  attributed  to  the 
same  mechanism0  The  answer  depends  on  the 
convention  we  adopt  for  quantifying  their  band- 
widths  If  we  take  the  usual  definition  in  terms 
of  the  frequency  at  half  the  peak  height,  the  two 
bandwidths  are  equal  Indeed,  if  we  normalize 
the  two  curves  to  the  same  peak  value  (at 
0  25  c  deg),  they  are  essentially  identical 

This  normalization  (of  threshold  elevation  on 
a  linear  scale  can  be  justified  if  we  assume  that 
the  high-velocity  mechanism  is  more  strongly 
adapted  by  patternless  flicker  than  by  moving 
gratings.  Since  none  of  our  other  results  con¬ 
tradict  that  view,  we  prefer  it  to  interpretations 
that  would  require  more  than  one  rrtechamsm  to 
account  for  these  data. 

(e)  Motion  detectors 

In  addition  to  the  mechanisms  we  have  con¬ 
sidered  so  far,  there  is  extensive  evidence  for  a 
third  type  of  mechanism  one  that  detects  the 
direction  of  motion  of  a  drifting  grating  or 


other  moving  stimulus  (Sekuler  and  Gan/.  1965. 
Levinson  and  Sekuler,  1 9'75,  Stromeyer  a  u /. 
1984).  Such  motion-selective  mechanisms  can  be 
found  in  the  same  high-velocity  region  where  we 
obtain  isotropic  masking  and  adaptation  effect- 
(Watson  et  al.,  1980;  Burr,  1981,  Hess  and 
Plant,  1985).  Now  a  d  irection-selectue  mech¬ 
anism  cannot  be  isotropic  So  how  can  our 
isotropic  results  be  obtained  in  the  presence  of 
such  a  mechanism? 

In  Fig.  8(a),  we  plot  two  pairs  of  adapted  and 
unadapted  thresholds  obtained  with  our  stan¬ 
dard  adaptation  paradigm,  where  the  adapting 
stimulis  is  a  moving  grating  and  the  test  stimuli' 
is  a  counterphase  flickering  grating  of  the  same 
spatial  and  temporal  frequencies  (Subic.: 
D.H.K.)  When  these  patterns  are  orthogonal 
the  threshold  elevation  ratio  at  60  deg  sec  is  2  '. 
when  they  are  parallel,  it  is  7  '  (siili  lower 
spatial  frequencies  are  required  to  make  the  two 
ratios  equal  for  this  subject,  as  described 
above). 

Now  if  we  change  the  paradigm  slight1'., 
changing  the  test  stimulus  from  a  flicker  ng  into 
a  moving  grating,  we  can  make  a  comparison 
with  the  classic  motion-adaptation  paradigm 
Here  we  must  consider  at  least  three  geometric' 
of  the  test  and  adapting  stimuli  parallel  i-ame 
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direction),  anti-paraile!  (opposite  direction), 
and  orthogonal.  Figure  8(b)  shows  the  adapted 
and  unadapted  thresholds  for  those  three  cases 
The  orthogonal  and  anti-parallel  ratios  are  es¬ 
sentially  the  same  as  with  the  flickering  test  (2.8 
and  4.1).  But  when  the  test  is  moving  in  the 
same  direction  as  the  adapting  grating,  then  the 
ratio  is  much  greater  (9.5)  than  we  can  obtain 
with  any  of  our  other  stimulus  configurations. 
This  is  of  course  a  well-known  result:  direction- 
selective  motion  adaptation. 

The  standard  explanation  for  the  difference 
between  the  parallel  and  antiparallel  results  is 
that  there  are  two  responding  mechanisms  that 
are  sensitive  to  opposite  directions  of  motion. 
But  the  orthogonal  adaptation  effect,  which  has 
about  the  same  magnitude  as  the  anti-parallel 
effect,  doesn’t  fit  into  that  scheme.  An  isotropic 
mechanism  (or  any  mechanism  that  is  not  nar¬ 
rowly  tuned  for  orientation)  should  respond 
equally  well  to  gratings  drifting  in  either  direc¬ 
tion.  Thus,  the  critical  question  posed  by  these 
results,  is:  If  there  is  an  isotropic  mechanism, 
why  doesn't  it  detect  the  drifting  grating  in  the 
case  of  parallel,  same-direction  adaptation  [Fig 
8(b)],  instead  of  leaving  detection  to  the  (now 
quite  insensitive)  motion  detector0  The  only 
plausible  explanation  that  occurs  to  us  is  that 
the  isotropic  mechanism  is  not  capable  of  de¬ 
tection  on  its  own,  instead,  it  is  a  distal  com¬ 
ponent  of  the  motion-sensitive  mechanism.  (The 
detection  site  clearly  follows  the  locus  of  motion 
sensitivity,  as  demonstrated  by  motion-selective 
adaptation  effects.)  We  suggest  that  the  iso¬ 
tropic  mechanism  feeds  into  the  motion  de¬ 
tecting  mechanisms  and  that  adaptation  occurs 
at  both  sites — the  isotropic  stage  and  the 
motion-detecting  stage 

Under  this  line  of  reasoning,  thresholds  for 
flickering  test  stimuli  (used  in  most  of  the 
experiments  reported  here)  should  have  been 
unaffected  by  adaptation  of  the  motion- 
sensitive  stage,  because  they  can  be  detected  by 
the  unadapted  motion-channel  that  is  sensitive 
to  the  direction-of-motion  opposite  to  that  of 
the  adapting  grating  The  quantitative  similarity 
of  the  results  for  orthogonal  adaptation  and  for 
opposite-direction  parallel  adaptation  is  consis¬ 
tent  with  this  interpretation  Finally,  small  re¬ 
sidual  differences  between  the  orthogonal  and 
anti-parallel  results  are  likely  to  be  the  result  of 
oriented,  nonmotion-specific  adaptation  (as 
seen  in  Figs  4  and  5)  Thus,  our  data  collectively 
suggest  the  existence  of  three  sites  of  spatial 
adaptation,  that  may  overlap  in  a  sizable  region 


of  the  spatiotemporal  domain  isotropic,  on 
ented,  and  direction-selective 

(/)  Subthreshold  summation 

Previous  studies  of  subthreshold  summation 
between  horizontal  and  vertical  gratings  having 
a  limited  range  of  spatial  and  temporal  fre¬ 
quencies  (e.g.  Kulikowski  et  ai,  1973)  showed 
the  independence  that  would  be  expected  of 
strongly  orientation-selective  mechanisms  To 
determine  whether  this  independence  breaks 
down  at  high  velocities,  as  suggested  by  our 
orthogonal  adaptation  (and  masking)  results, 
we  conducted  subthreshold-summation  experi¬ 
ments  with  stabilized,  counterphase-flickering 
gratings  at  spatio-temporal  frequency  pairs  of 
6c/deg,  1  Hz;  0  5c/deg,  10  Hz,  and  0.25  c  deg 
15Hz.  Complete  horizontal  vertical  indepen¬ 
dence  was  obtained  with  the  lowest  velnc.tv 
stimulus,  as  expected 

Figure  9  shows  the  more  interesting  results, 
with  higher  velocity  stimuli  At  the  highes’ 
velocity  obtainable  at  our  standard  viewing 
distance  (0.25c  deg.  15  Hz),  we  did  obtain  a 
significant  interaction  between  horizon’,  a.  jrv. 
vertical  thresholds  (summation  cxponeri- 
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Fig  9  Subthreshold  summation  between  horizon:**1  an«! 
vertical.  high  selocits  gratings  under  two  conditions  ais. ■ 
used  for  pattern  adaptation  All  thresholds  normalized  to 
the  horizontal  and  vertical  component  thresholds  Sub  rv 
DHK  ,  open  symbols,  method  of  adjustment.  sMul  wrv 
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shown  in  Fig  9(a)  Thus  the  expected  trend  is 
present 

However,  at  lower  velocities,  we  found  com¬ 
plete  threshold  independence  Figure  9(h)  shows 
data  for  0.5  c  deg,  10  Hz  The  same  subject 
shows  considerable  orthogonal  adaptation  with 
this  frequency  pair,  see  Figs  4(b)  and  5  We 
emphasize  that  there  is  no  such  conflict  between 
masking  and  pattern  adaptation,  only  between 
the  threshold  and  suprathreshold  techniques 
Subthreshold  summation  yields  narrower  esti¬ 
mates  of  onet.'ation  tuning  than  do  techniques 
involving  suprathreshold  stimuli,  as  has  pre¬ 
viously  been  found  in  other  spatiotemporal 
frequency  regions  as  well  (Blakemore  and 
Nachmias,  1971;  Kulikowski  et  a! .,  1973; 
Thomas  and  Gille.  1979) 

DISCUSSION 

Taken  together,  the  present  adaptation  study 
and  our  previous  masking  results  (Burbeck  and 
Kelly,  1981)  provide  strong  support  for  the 
notion  that  an  isotropic,  adaptable  mechanism 
is  involved  in  the  detection  of  high-velocity 
gratings  New  mechanisms  should  always  be 
accepted  with  caution  but  in  this  case,  there  is 
a  well-known  body  of  earlier  work  that  seems 
closely  related  to  our  results  The  isotropic 
mechanism  found  in  our  experiments  appears  to 
be  the  same  as  the  so-called  "transient"  mech¬ 
anism  of  numerous  other  studies 

If  our  inference  is  correct  that  a  single  mech¬ 
anism  is  being  adapted,  both  by  patternless 
flicker  and  by  high-velocity  gratings,  then  the 
identity  of  the  two  mechanisms  seems  clear  Our 
isotropic  mechanism  is  broadband  in  its  tempo¬ 
ral  frequency  response,  peaking  at  a  high  flicker 
frequency,  and  is  low-pass  in  its  spatial  re¬ 
sponse.  cutting  off  at  a  few  cycles  per  degree 
This  description  closely  matches  one  suggested 
earlier  by  Kulikowski  and  Tolhurst  (1973),  and 
confirmed  experimentally  many  times  (Kelly 
and  Burbeck,  1984) 

This  suggests  that  the  present  study  could  be 
regarded  as  an  attempt  to  measure  the  orien¬ 
tation  tuning  of  the  transient  mechanism  If  the 
characteristics  of  this  mechanism  are  most 
clearly  revealed  at  the  highest  velocities  as 
suggested  by  the  larger  adaptation  effects  ob¬ 
tained  with  the  lowest  spatial,  highest  temporal 
frequency  combinations  then  the  "transient' 
mechanism  has  no  orientation  tuning  at  all,  but 
is  completely  isotropic  That  conclusion  is  sup¬ 
ported  by  the  fact  that  the  largest  adaptation 
effect  was  obtained  with  a  patternless  (hence 


non-onented)  adapting  field,  and  is  also  consis 
tent  with  the  flicker-masking  results  in  the  litera¬ 
ture  (Breitmeyer  el  al .  1981,  Green,  l‘)84i 
W’hat  else  is  known  about  the  "high velovit' 
corner"  of  the  spatiotemporal  frequencs  do¬ 
main'’  In  several  experiments  with  sinewave 
stimuli,  this  region  has  revealed  other  sisua! 
properties  not  found  elsew  here  Historically .  the 
earliest  of  these  properties  to  be  discovered  was 
the  linearity  of  the  flicker  threshold  It  was 
found  that  the  threshold  modulation  for  various 
periodic  waveforms  could  be  predicted  from  a 
knowledge  of  the  sinewave  modulation  thresh¬ 
olds  at  high  temporal  frequencies  (Ives.  1922, 
De  Lange,  1952;  Kelly,  1961)  Measured  in 
terms  of  retinal  illuminance,  the  threshold  for 
these  Founer-equi valent  waveforms  is  also  inde¬ 
pendent  of  the  d.c.  component  of  the  stimulus 
(Kelly,  1964),  a  generalization  of  Talbot’s  law 
This  linear  independence  of  the  background 
level  is  found  only  with  low  spatial  and  high 
temporal  frequencies.  In  other  parts  of  the 
spatiotemporal  domain,  sinewave  amplitude 
thresholds  vary  with  the  d.c.  component,  fol¬ 
lowing  well-known  adaptation  laws:  Weber's 
law  when  both  temporal  and  spatial  frequencies 
are  low,  and  the  De  Vries-Rose  law  when  the 
spatial  frequency  is  high  (Kelly.  1972) 

Another  property  found  only  in  the  high 
velocity  corner  of  the  spatiotemporal  domain 
has  been  called  spatial-frequency  doubling 
(Kelly,  1966.  1981)  In  this  phenomenon,  ampli¬ 
tude  distortion  at  an  early  stage  of  the  visual 
process  results  in  the  appearance  oT  a  second 
harmonic  of  the  spatial  frequency  of  a  low 
frequency  grating  when  it  flickers  at  a  high 
temporal  frequency,  if  the  contrast  of  the  stim¬ 
ulus  is  well  above  threshold 

Drawing  on  the  available  results,  we  suggest 
that  the  mechanism  previously  identified  as 
“transient"  is  isotropic,  low-pass  in  the  spatial- 
frequency  domain,  tuned  to  high  temporal  Ire 
quencies.  linear  at  threshold  and  highlv  non 
linear  above  threshold  This  mechanism 
probably  constitutes  a  stage  in  the  input  to 
direction-selective  motion  detectors  In  other 
respects,  however,  its  functional  significance  re¬ 
mains  an  intriguing  question 
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